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Abstract 



We investigate complexity issues related to pure Nash equilibria of strategic games. We 
show that, even in very restrictive settings, determining whether a game has a pure Nash 
Equilibrium is NP-hard, while deciding whether a game has a strong Nash equilibrium is 
Sl'-complete. We then study practically relevant restrictions that lower the complexity. 
In particular, we are interested in quantitative and qualitative restrictions of the way each 
player's payoff depends on moves of other players. We say that a game has small neighbor- 
hood if the utility function for each player depends only on (the actions of) a logarithmically 
small number of other players. The dependency structure of a game Q can be expressed 
by a graph G(Q) or by a hypergraph H{G)- By relating Nash equilibrium problems to 
constraint satisfaction problems (CSPs), we show that if Q has small neighborhood and if 
H(G) has bounded hypertree width (or if G(G) has bounded treewidth), then finding pure 
Nash and Pareto equilibria is feasible in polynomial time. If the game is graphical, then 
these problems arc LOGCFL-complete and thus in the class NC2 of highly parallclizablc 
problems. 

1. Introduction and Overview of Results 

The theory of strategic games and Nash equilibria has important applications in economics 
and decision making (Nash, 1951; Aumann, 1985). Determining whether Nash equilib- 
ria exist, and effectively computing them, are relevant problems that have attracted much 
research in computer science (e.g. Deng, Papadimitriou, & Safra, 2002; McKelvey & McLen- 
nan, 1996; Koller, Megiddo, & von Stengel, 1996). Most work has been dedicated to com- 
plexity issues related to mixed equilibria of games with mixed strategies, where the player's 
choices are not deterministic and are regulated by probability distributions. In that con- 
text, the existence of a Nash equilibrium is guaranteed by Nash's famous theorem (Nash, 
1951), but it is currently open whether such an equilibrium can be computed in polynomial 
time (cf., Papadimitriou, 2001). First results on the computational complexity for a two- 
person game have been presented by Gilboa and Zemel (1989), while extensions to more 
general types of games have been provided by Megiddo and Papadimitriou (1991), and by 
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Papadimitriou (1994b). A recent paper of Conitzer and Sandholm (2003b) also proved the 
NP-hardness of determining whether Nash equilibria with certain natural properties exist. 

In the present paper, we are not dealing with mixed strategies, but rather investigate the 
complexity of deciding whether there exists a Nash equilibrium in the case of pure strategies, 
where each player chooses to play an action in a deterministic, non-aleatory manner. Nash 
equilibria for pure strategies are briefly referred to as pure Nash equilibria. Note that in 
the setting of pure strategies, a pure Nash equilibrium is not guaranteed to exist (see, 
for instance, Osborne & Rubinstein, 1994). Particular classes of games having pure Nash 
equilibria have been studied by Rosenthal (1973), Monderer and Shapley (1993), and by 
Fotakis et al. (2002). Recently, Fabrikant at el. (2004) renewed the interest in the class 
of games defined Rosenthal (1973), called congestion games, by showing that a pure Nash 
equilibrium can be computed in polynomial time in the symmetric network case, while the 
problem is PLS-complete (Johnson, Papadimitriou, & Yannakakis, 1998) in general. 

Our goal is to study fundamental questions such as the existence of pure Nash, Pareto, 
and strong Nash equilibria, the computation of such equilibria, and to find arguably realistic 
restrictions under which these problems become tractable. Throughout the paper, Pareto 
and strong Nash equilibria are considered only in the setting of pure strategies. 

While pure strategies are conceptually simpler than mixed strategies, the associated 
computational problems appear to be harder. In fact, we show that even if severe restric- 
tions are imposed on the set of allowed strategies, determining whether a game has a pure 
Nash or Pareto Equilibrium is NP-complete, while deciding whether a game has a strong 
Nash equilibrium is even -complete. However, by jointly applying suitable pairs of more 
realistic restrictions, we obtain settings of practical interest in which the complexity of the 
above problems is drastically reduced. In particular, determining the existence of a pure 
Nash equilibrium and computing such an equilibrium will be feasible in polynomial time 
and we will show that, in certain cases, these problems are even complete for the very low 
complexity class LOGCFL, which means that these problems are essentially as easy as the 
membership problem for context-free languages, and are thus highly parallelizable (in NC2). 

In the setting of pure strategies, to which we will restrict our attention in the rest of 
this paper, a finite strategic game is one in which each player has a finite set of possible 
actions, from which she chooses an action once and for all, independently of the actual 
choices of the other players. The choices of all players can thus be thought to be made 
simultaneously. The choice of an action by a player is referred to as the player's strategy. 
It is assumed that each player has perfect knowledge over all possible actions and over 
the possible strategies of all players. A global strategy, also called profile in the literature, 
consists of a tuple containing a strategy for each player. Each player has a polynomial-time 
computable real valued utility function, which allows her to assess her subjective utility of 
each possible global strategy (global strategies with higher utility are better). A pure Nash 
equilibrium (Nash, 1951) is a global strategy in which no player can improve her utility by 
changing her action (while the actions of all other players remain unchanged). A strong 
Nash equilibrium (Aumann, 1959) is a pure Nash equilibrium where no change of strategies 
of whatever coalition (i.e., group of players) can simultaneously increase the utility for all 
players in the coalition. A pure Nash equilibrium is Pareto optimal (e.g. Maskin, 1985) if 
the game admits no other pure Nash equilibrium for which each player has a strictly higher 
utility. A Pareto-optimal Nash equilibrium is also called a Pareto Nash Equilibrium. 
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Before describing our complexity results, let us discuss various parameters and features 
that will lead to restricted versions of strategic games. We consider restrictions of strategic 
games which impose quantitative and/or qualitative limitations on how the payoffs of an 
agent (and hence her decisions) may be influenced by the other agents. 

The set of neighbors Neigh(p) of a player is the set of other players who potentially 
matter w.r.t. p's utility function. Thus, whenever a player q ^ pis not in Neigh(p) then p's 
utility function does not directly depend on the actions of q. We assume that each game 
is equipped with a polynomial-time computable function Neigh with the above property. 1 
The player neighborhood relationship, typically represented as a graph (or a hypergraph), 
is the central notion in graphical games (Roller & Milch, 2001; Kearns, Liftman, & Singh, 
2001b), as we will see in more detail in the next section. 

A first idea towards the identification of tractable classes of games is to restrict the 
cardinality of Neigh(p) for all players p. For instance, consider a set of companies in a 
market. Each company has usually a limited number of other market players on which it 
bases its strategic decisions. These relevant players are usually known and constitute the 
neighbors of the company in our setting. However, note that even in this case the game 
outcome still depends on the interaction of all players, though possibly in an indirect way. 
Indeed, the choice of a company influences the choice of its competitors, and hence, in turn, 
the choice of competitors of its competitors, and so on. In this more general setting, a 
number of real-world cases can be modeled in a very natural way. We can thus define the 
following notion of limited neighborhood: 

Bounded Neighborhood: Let k > be a fixed constant. A strategic game with as- 
sociated neighborhood function Neigh has k-bounded neighborhood if, for each player p, 
\Neigh{p)\ < k. 

While in some setting the bounded neighborhood assumption is realistic, in other set- 
tings the constant bound appears to be too harsh an imposition. It is much more realistic 
and appealing to relax this constraint and consider a logarithmic bound rather than a con- 
stant bound on the number of neighbors. 

Small Neighborhood: For a game Q denote by P{Q) the set of its players, by Act(p) 
the set of possible actions of a player p, and by \\Q\\ the total size of the description of a 
game Q (i.e., the input size n). Furthermore, let maxNeigh(Q) = max p( zp^ \ Neigh(p)\ and 
maxAct(Q) = max p< z P ^\Act(p)\. 

A class of strategic games has small neighborhood if, for each game Q in this class, 

maxNeigh(Q) = 0(- iiMU ) 

y y J dog maxAct{<5y 

Note the denominator log maxAct(Q) in the above bound. Intuitively, we use this term 
to avoid "cheating" by trading actions for neighbors. Indeed, roughly speaking, player 
interactions may be reduced significantly by adding an exponential amount of additional 
actions. For any player, these fresh actions may encode all possible action configurations of 

1. Note that each game can be trivially represented in this setting, possibly setting Neigh(p) to be the 
set of all players, for each player p. In most cases, however, one will be able to provide a much better 
neighborhood function. 
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some of her neighbors, yielding an equivalent game with less interaction, and possibly with 
fewer players, too. The denominator takes this into account. 

In other terms, a class of games has small neighborhood if there is a constant c such 
that for all but finitely many pairs (Q,p) of games and players, \Neigh(p)\ < c x ( log" Ac^(p) )• 

The related notion i(Q) of intricacy of a game is defined by: 

, . maxNeigh{Q) x log max Act (G) 
lo g||£|| 

It is clear that a class of games has small neighborhood if and only if the intricacy of all 
games in it is bounded by some constant. 

Obviously bounded neighborhood implies small neighborhood, but not vice-versa. We 
believe that a very large number of important (classes of) games in economics have the 
small neighborhood property. 

In addition to the quantitative aspect of the size of the neighborhood (and of the neigh- 
borhood actions), we are also interested in qualitative aspects of mutual strategic influence. 
Following Kearns et al. (2001b), for a game Q with a set P of players, we define the strate- 
gic dependency graph as the undirected graph G(Q) having P as its set of vertices and 
{{p,l} I Q £ P A p £ Neigh(q)} as its set of edges. Moreover, we define the strategic de- 
pendency hypergraph H((?), whose vertices are the players P and whose set of hyperedges is 
{{p} U Neigh(p) \ p € P}. For instance, consider a game Q over players A, B, C, and D such 
that Neigh(A) = {B, C}, Neigh(B) = {A, C}, Neigh(C) = {A, B], and Neigh(D) = {C}. 
Figure 1 shows the dependency graph and the dependency hypergraph associated with Q. 

We consider the following classes of structurally restricted games: 

Acyclic-Graph Games: Games Q for which G(<7) is acyclic. 

Acyclic-Hypergraph Games: Games Q for which H(£) is acyclic. Note that there are 
several definitions of hypergraph acyclicity (Fagin, 1983). Here we refer to the broadest 
(i.e., the most general) one, also known as a-acyclicity (Fagin, 1983; Beeri, Fagin, Maier, 
& Yannakakis, 1983) (see Section 2). 

Each acyclic-graph game is also an acyclic-hypergraph game, but not vice-versa. As an 
extreme example, let Q be a game with player set P in which the utility of each action for 
each player depends on all other players. Then G(<7) is a clique of size \P\ while H(£/) is 
the trivially acyclic hypergraph having the only hyperedge {P}- 

For strategic games, both the acyclic graph and the acyclic hypergraph assumptions are 
very severe restrictions, which are rather unlikely to apply in practical contexts. However, 
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there are important generalizations that appear to be much more realistic for practical 
applications. These concepts are bounded treewidth (Robertson & Seymour, 1986) and 
bounded hypertree width (Gottlob, Leone, & Scarcello, 2002b) (see also Section 5), which 
are suitable measures of the degree of cyclicity of a graph and of a hypergraph, respectively. 
In particular, each acyclic graph (hypergraph) has treewidth (hypertree width) < 1. It was 
argued that an impressive number of "real-life" graphs have a very low treewidth (Downey 
& Fellows, 1995). Hypertree width in turn was fruitfully applied in the context of database 
queries (Gottlob et al., 2002b) and constraint satisfaction problems (Gottlob, Leone, & 
Scarcello, 2000). Formal definitions are given in Section 5. Note that both computing 
the treewidth of a graph and the hypertree width of a hypergraph are NP-hard problems. 
However, for each (fixed) constant k, it can be checked in polynomial time whether a 
graph has treewidth k (Bodlaender, 1997) and whether a hypergraph has hypertree width 
k (Gottlob et al., 2002b). We have, for each constant k, the following restricted classes of 
games: 

Games of treewidth bounded by k: The games Q such that the treewidth of G{Q) 
is < k. 

Games of hypertree width bounded by k: The games Q such that the hypertree 
width of H(C7) is < k. 

In the context of complexity and efficiency studies, it is very important to make clear 
how an input (in our case, a multiplayer game) is represented. We say that a game is 
in general form if the sets of players and actions are given in extensional form and if 
the neighborhood and utility functions are polynomially computable functions. Unless 
otherwise stated, we always assume that games are given in general form. For classes of 
games having particular properties, some alternative representations have been used by 
various authors. For instance, in game theory literature, the set of utility functions is often 
represented through a single table (or matrix) having an entry for each combination of 
players' actions containing, for each player p, the evaluation of her utility function for that 
particular combination. This representation is said to be in standard normal form (SNF) 
(see, for instance, Osborne & Rubinstein, 1994; Owen, 1982). Note that, if there are many 
players, this representation may be very space consuming, particularly if some players are 
not interested in all other players, but only in some subset of them. Moreover, in this case, 
the monolithic utility table in SNF obscures much of the structure that is present in real- 
world games (Roller & Milch, 2001). In fact, in the context of games with restricted players 
interactions, the most used representation is the graphical normal form ( GNF). In GNF 
games, also known as graphical games (Reams, Littman, & Singh, 2001a; Reams et al., 
2001b; Reams & Mansour, 2002; Vickrey, 2002), the utility function for each player p is 
given by a table that displays p 7 s utility as a function of all possible combined strategies of 
p and p's neighbors, but not of other players irrelevant to p. Therefore, for large population 
games (modeling for instance agent interactions over the internet), the SNF is practically 
unfeasible, while the more succinct graphical normal form works very well, and is actually 
a more natural representation. 

Main results. The main results of this paper are summarized as follows: 
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Determining whether a strategic game has a pure Nash equilibrium is NP-complete 
and remains NP-complete even for following two restricted cases: 

— Games in graphical normal form (GNF) having bounded neighborhood (Theo- 
rem 3.1). 

- Acyclic-graph games, and acyclic- hypergraph games (Theorem 3.2). 

The same results hold for Pareto Nash equilibria for pure strategies. 

Determining whether a strategic game has a strong Nash equilibrium is S^-complete 
and thus at the second level of the Polynomial Hierarchy (Theorem 3.7 and Theo- 
rem 3.8). The proof of this theorem gives us a fresh game-theoretic view of the class 
as the class of problems whose positive instances are characterized by a coalition 
of players who cooperate to provide an equilibrium, and win against any other dis- 
joint coalition, which fails in trying to improve the utility for all of its players. E.g., 
in the case of £2 quantified Boolean formulas, the former coalition consists of the 
existentially quantified variables, and the latter of the universally quantified ones. 

The pure Nash, Pareto and strong equilibrium existence and computations problems 
are feasible in logarithmic space for games in standard normal form (Theorem 4.1). 

The pure Nash equilibrium existence and computation problems are tractable for 
games (in whatever representation) that simultaneously have small neighborhood and 
bounded hypertree width (Theorem 5.3). Observe that each of the two joint restric- 
tions, small neighborhood and bounded hypertree width, is weaker than the restric- 
tions of bounded neighborhood and acyclicity, respectively, of which each by itself does 
not guarantee tractability. Thus, in order to obtain tractability, instead of strength- 
ening a single restriction, we combined two weaker restrictions. While we think that 
each of the two strong restrictions is unrealistic, we believe that for many natural 
games the combined weaker restrictions do apply. In order to prove the tractability 
result, we establish a relationship between strategic games and the well-known finite 
domain constraint satisfaction problem (CSP), much studied in the AI and OR liter- 
ature (e.g. Vardi, 2000; Gottlob et al., 2000). Let us point out that also Vickrey and 
Koller (2002) recently exploited a mapping to CSP for the different problem of finding 
approximate mixed equilibria in graphical games. We show that each (general, not 
necessarily GNF) strategic game Q can be translated into a CSP instance having the 
same hypertree width as Q, and whose feasible solutions exactly correspond to the 
Nash equilibria of the game. Then, we are able to prove that Q is equivalent to an 
acyclic constraint satisfaction problem of size \\Q\\°^) xhw( ~ Q )) ^ where i(Q) is the in- 
tricacy of Q and hw{G) is the hypertree width of its strategic dependency hypergraph. 
Acyclic CSPs, in turn, are well-known to be solvable in polynomial time. 

Exploiting the same relationship with CSPs, we prove that the Nash-equilibrium ex- 
istence and computation problems are tractable for games in graphical normal form 
(GNF) having bounded hypertree width (Theorem 5.3), regardless of the game intri- 
cacy, i.e., even for unbounded neighborhood. 
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• We show that if a strategic game has bounded treewidth, then it also has bounded 
hypertree width (Theorem 5.7). Note that this is a novel result on the relationship 
between these two measures of the degree of cyclicity, since earlier works on similar 
subjects dealt with either the primal or the dual graph of a given hypergraph, rather 
than with a dependency graph, as we do in the present paper, focused on games. Com- 
bined with the two previous points, this entails that the Nash-equilibrium existence 
and computation problems are tractable for games that simultaneously have small 
neighborhood and bounded treewidth, and for GNF games having bounded treewidth 
(Corollary 5.9). 

• In all above cases where a pure Nash Equilibrium can be computed in polynomial time, 
also a Pareto Nash equilibrium can be computed in polynomial time (Theorem 4.6 
and Corollary 5.4). 

• These tractability results partially extend to strong Nash equilibria. Indeed, the 
checking problem becomes feasible in polynomial time for acyclic-hypergraph games 
in GNF. However, even in such simple cases, deciding whether a game has strong 
Nash equilibria is NP-complete, and thus still untractable (Theorem 4.8). 

• We go a bit further, by determining the precise complexity of games with acyclic 
(or even bounded width) interactions among players: In case a game is given in 
GNF, the problem of determining a pure Nash equilibrium of a game of bounded 
hypertree-width (or bounded treewidth) is LOGCFL-complete and thus in the par- 
allel complexity class NC2 (Theorem 6.1). Membership in LOGCFL follows from 
the membership of bounded hypertree-width CSPs in LOGCFL (Gottlob, Leone, & 
Scarcello, 2001). Hardness for LOGCFL is shown by transforming (logspace uniform 
families of) semi- unbounded circuits of logarithmic depth together with their inputs 
into strategic games, such that the game admits a Nash equilibrium if and only if the 
circuit outputs one on the given input. 

Figure 2 summarizes our results on the existence of pure Nash equilibria. 
While various authors have dealt with the complexity of Nash equilibria (e.g. Gilboa & 
Zemel, 1989; Papadimitriou, 1994b; Roller & Megiddo, 1992, 1996; Conitzer & Sandholm, 
2003b), most investigations were dedicated to mixed equilibria and — to the best of our 
knowledge — all complexity results in the present paper are novel. We are not aware of any 
other work considering the quantitative and structural restrictions on pure games studied 
here. Note that tree-structured games were first considered by Kearns et al. (2001b) in 
the context of mixed equilibria. It turned out that, for such games, suitable approximation 
of (mixed) Nash equilibria can be computed in polynomial time. In our future work, we 
would like to extend our tractability results even to this setting. We are not aware of 
any work by others on the parallel complexity of equilibria problems. We believe that 
our present work contributes to the understanding of pure Nash equilibria and proposes 
appealing and realistic restrictions under which the main computation problems associated 
with such equilibria are tractable. 

The rest of the paper is organized as follows. In Section 2 we introduce the basic notions 
of games and Nash equilibria that are studied in the paper, and we describe how games 
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Figure 2: Complexity of deciding existence of pure Nash equilibria for games in GNF 
numbers indicate theorems where the corresponding results are proved. 



may be represented. In Section 3 we thoroughly study the computational complexity of 
deciding the existence of pure Nash, Pareto and strong equilibria. In Section 4 we identify 
tractable classes of games, and in Section 5 we extend our tractability results to larger 
class of games, where the interaction among players has a bounded degree of cyclicity. In 
Section 6 we improve the results on the polynomial tractability of easy games, providing the 
precise computational complexity for games with acyclic (or bounded width) interactions 
among players. Finally, in Section 7, we draw our conclusions, and we discuss possible 
further research and related works. 
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2. Games and Nash Equilibria 

A game Q is a tuple (P, Neigh, Act, U), where P is a non-empty set of distinct players and 
Neigh : P — ► 2 P is a function such that for each p G P, Neigh(p) C P — {p} contains 
all neighbors of p, Act : P — ► A is a function returning for each player p a set of possible 
actions Act(p), and U associates a utility function u p : Act(p) Xj^Neigh(p) Act(j) — > to 
each player p. 

Note that, in general, the players interests are not symmetric. Thus, it may happen 
that, for a pair of players pi,P2 £ P, Pi £ Neigh(p2) but P2 Neigh(pi). 

For a player p, p a denotes her choice to play the action a £ Aci(p). Each possible p a is 
called a strategy for p, and the set of all strategies for p is denoted by St(p)? 

For a non-empty set of players P' C P, a combined strategy for P' is a set containing 
exactly one strategy for each player in P'. St(P') denotes the set of all combined strategies 
for the players in P' . 

A combined strategy (also, profile) x is called global if all players contribute to it, that 
is, if P' = P. The global strategies are the possible outcomes of the game. 

A set of players K C P is often called a coalition. Let x be a global strategy, K a 
coalition, and y a combined strategy for K. Then, we denote by x_#-[y] the global strategy 
where, for each player p £ K, her individual strategy p a E x is replaced by her individual 
strategy pt, £ y. If iv" is a singleton {p}, we will simply write x_ p [y]. 

Let x be a global strategy, p a player, and u p the utility function of p. Then, with a 
small abuse of notation, u p (x) will denote the output of u p on the projection of x to the 
domain of u p , i.e., the output of the function u p applied to the actions played by p and her 
neighbors according to the strategy x. 

In the context of complexity and efficiency studies it is very important to make clear 
how an input (in our case, a multiplayer game) is represented. 

General Form: A game is in general form if the sets of players and actions are given in 
extensional form, while the neighborhood and utility functions are given intentionally, e.g., 
through encodings of deterministic Turing transducers. More precisely, we are interested in 
classes of games such that the computation time of the neighborhood and utility functions 
is globally bounded by some polynomial. Let us denote by the class of all games Q 
in general form whose neighborhood and utility functions are computable in time 0(n k ), 
where n = \Q\. 

For the sake of presentation, we assume hereafter k > 1 to be any such a fixed global 
bound. Moreover, unless otherwise stated, when we speak of a "general game Q" (or we 
omit any specification at all) we mean a game Q £ C^. 

The following more restrictive classes of (representations of) games have been used by 
many authors. 

Standard Normal Form (SNF): A game with set P of players is in standard normal 
form (SNF) if its utility functions are explicitly represented by a single table or matrix 
having an entry (or cell) for each global strategy x, displaying a list containing for each player 

2. Note the technical distinction between actions and strategies: an action is an element of the form a, 
while a strategy is an element of the form p a , i.e., it is an action chosen by a player. This helps in 
technical proofs, since a strategy singles out both a player and her choice. 
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p, p's payoff u p (x) w.r.t. x. (Equivalently, we may describe the utilities by \P\ such tables, 
where the i-th table describes just the payoff of player i.) This is a representation of utility 
functions often assumed in the literature (see, for instance, Osborne & Rubinstein, 1994; 
Owen, 1982). Observe that, in the general case, even if an utility function is polynomially 
computable, writing it down in form of a table may require exponential space. 

Graphical Normal Form (GNF): A game with a set P of players is in graphical normal 
form ( GNF) if the utility function for each player p is represented by a separate table 
containing a cell for each combined strategy x € St{Neigh{p) U {p}) of the p's set of 
neighbors Neigh(p)U{p}, displaying p's payoff u p (x) w.r.t. x. A game in GNF is illustrated 
in Example 2.1. The GNF representation has been adopted in several recent papers that 
study games with a large number of players, where the utility function of each player depends 
directly only on the strategies of those (possibly few) players she is interested in (e.g. Kearns 
et al., 2001a, 2001b; Kearns & Mansour, 2002; Vickrey, 2002). Note that GNF may lead to 
an exponentially more succinct game representation than SNF. Notwithstanding, the SNF 
is often used in the literature, mostly because, historically, the first investigations focused 
on two-player games. Moreover, games in GNF are often referred to as graphical games. 
We prefer to use the phrasing games in graphical normal form, because this makes clear 
that we are addressing representational issues. 

The following example, to which we will refer throughout the paper, should sound 
familiar to everyone, as it is a generalization of the well known two-person game "battle of 
sexes" . 

Example 2.1 (FRIENDS) Let us consider the game FRIENDS, that is played by a group 
of persons that have to plan their evening happenings. The players are George (short: G), 
Pauline (P), Frank (F), Robert (R), and Mary (M). Each of them have to decide to go 
either to see a movie (m) or to see an opera (o). However, preferences concern not only the 
particular option (m or o) to be chosen, but usually also the persons to join for the evening 
(possibly, depending on the movie or opera choice). For instance, we assume that Frank 
is interested in joining Pauline and Robert. He would like to join both of them. However, 
Pauline is an expert of movies and Robert is an expert of operas. Thus, if it is not possible 
to go out all together, he prefers to go to the cinema with Pauline and to the opera with 
Robert. Pauline would like to stay with Frank, and she prefers the movies. Robert does 
not like Frank because he speaks too much and, as we know, he prefers the opera. Mary, 
too, likes operas and would like to go to the opera with Robert. Finally, George is the 
matchmaker of the group: He has no personal preferences but would like that Frank and 
Pauline stay together for the evening, best if they go to the cinema. All the utility functions 
associated with this game are shown in Figure 3, where we denote the fact that a player X 
chooses an action a by X a , e.g., F m denotes the strategy where Frank chooses to play the 
action m. □ 

Let us now formally define the main concepts of equilibria to be further studied in this 
paper. 

Definition 2.2 Let Q = (P, Neigh, A, U) be a game. Then, 

366 



Pure Nash Equilibria: Hard and Easy Games 



r 


P B 
1 m 1 L m 


r 
r 


D 


P 7? 
1 o 1 






c 
\j 


p p 


P P 
J m L o 


p p 


p p 


m 


2 




2 


1 









TO 


2 








1 










2 


1 


2 









2 








1 






R 


1 m 


F 


P 




P 

1 m 


Po 


M 




R 








m 





1 


TO 




2 





TO 


l 











o 


2 





O 







1 








2 





Figure 3: Utility functions for FRIENDS in GNF 



• a global strategy x is a pure Nash Equilibrium for Q if, for every player p G P, 
flpa G such that u p (x) < u p (x-p[p a }); 

• a global strategy x is a pure strong Nash Equilibrium for Q if, MK C P, Vy £ 
St(K), Bp £ K such that u p (x) > u p (x_x[2/]) or, equivalently, if \/K C P, /9y G 
St(K) such that, Vp G K, m p (x) < u p (x_^[?/]); 

• a pure Nash equilibrium x is a pure Pareto Nash Equilibrium for Q if there does not 
exist a pure Nash equilibrium y for Q such that, Vp G P, %>(x) < u p (y). 3 

The sets of pure Nash, strong Nash, and Pareto Nash equilibria of Q are denoted by 
J\f£(G), SN£{G), and VM£{Q), respectively. It is easy to see and well known that the 
following relationships hold among these notions of Nash equilibria: SN£{Q) C VN£{Q) C 
N£(Q). Moreover, the existence of a Nash equilibrium does not imply the existence of a 
strong Nash equilibrium. However, if there exists a Nash equilibrium, then there exists also 
a Pareto Nash equilibrium. 

Example 2.3 The strategies {F m , P m , R Q , G m , M }, {F m ,P m ,R ,G ,M }, 
{F ,P ,R m ,G m ,M m } and {F Q , P , R rn , G Q , M m } are the Nash equilibria of the FRIENDS 
game. For instance, consider the latter strategy, where all players get payoff 1. In this 
case, since P plays opera and R plays movie, F cannot improve his payoff by changing from 
opera to movie. The same holds for G, while R, P, and M would get the lower payoff 0, if 
they change their choices. 

Moreover, note that the first two strategies above, namely {F m ,P m ,R ,G m ,M } and 
{F m , P m , R , G , M Q }, are the only Pareto Nash equilibria, as well as the strong Nash equi- 
libria. Indeed, for these global strategies all players get their maximum payoff 2, and thus 
there is no way to improve their utilities. □ 

The interaction among players of Q can be more generally represented by a hypergraph 
H(G) whose vertices coincide with the players of Q and whose set of (hyper)edges contains 
for each player p a (hyper)edge H(p) = {p} U Neigh(p), referred-to as the characteristic edge 
of p. Intuitively, characteristic edges correspond to utility functions. 

3. Note that only pure strategies do matter in this definition, as there is no requirement with regard to 
how pure candidate equilibria compare to possible mixed equilibria. 
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A fundamental structural property of hypergraphs is acyclicity. Acyclic hypergraphs 
have been deeply investigated and have many equivalent characterizations (e.g. Beeri et al., 
1983). We recall here that a hypergraph H is acyclic if and only if there is a join tree for H, 
that is, there is a tree JT whose vertices are the edges of H and, whenever the same player 
p occurs in two vertices v\ and i>2 , then v\ and vi are connected in JT, and p occurs in each 
vertex on the unique path linking v\ and V2 (see Figure 5 for a join tree of H(FRIENDS)). 
In other words, the set of vertices in which p occurs induces a (connected) subtree of JT. 
We will refer to this condition as the Connectedness Condition of join trees (also known as 
running intersection property). 

Another representation of the interaction among players is through the (undirected) 
dependency graph G{Q) = (P, E), whose vertices coincide with the players of Q, and {p, q} G 
E if p is a neighbor of q (or vice versa). For completeness we observe that, even if most works 
on graphical games use this dependency graph, another natural choice is representing the 
game structure by a directed graph (also called influence graph), which takes into account 
the fact that payoffs of a player p may depend on payoffs of a player q and not vice versa, in 
general. Following Kearns et al. (2001b), in the present paper we use the undirected version 
because we are interested in identifying game structures that possibly allow us to compute 
efficiently Nash equilibria, and directed graphs do not help very much for this purpose. Let 
us give a hint of why this is the case, by thinking of a group of players X = {X\, . . . , X n }, 
each one having only one neighbor C, whose payoffs do not depend on any player in X. 
Player C has one neighbor D, who has C has its only neighbor. Figure 4 shows a directed 
graph representing these player interactions. It is easy to design a game with these players 




Figure 4: A directed graph representation of player interactions. 

such that, for some combined strategy x of the X players, there is no Nash equilibrium, 
while for some other combined strategy x' of these players, there is a combined strategy y 
of C and D such that the union of x' and y is a Nash equilibrium for the game. Therefore, 
as far as the possibility of reaching a Nash equilibrium is concerned, the choices of players 
in X depend on each other, on the way of playing of C, and transitively on player D, too. 
Observe that the undirected dependency graph represents in a succinct way, i.e., through 
their direct connections, such a mutual relationship among players. However, the direct 
graph does not model this kind of influence, as looking at this graph it seems that players 
in X should not worry about any other player in the game. In fact, exploiting the gadgets 
and the constructions described in this paper, it is easy to see that even simple games whose 
directed influence graphs are quasi-acyclic (i.e., they are acyclic, but for some trivial cycles 
like the one shown in Figure 4), are hard to deal with. Thus, apart from the well known 
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Figure 5: Hypergraph, dependency graph, and primal graph of the FRIENDS game. On 
the right, a join tree for H(FRIENDS). 



easy acyclic cases, any reasonable generalization of the notion of direct acyclicity does not 
appear to be useful for identifying further tractable classes of games. 

Observe that the dependency graph G(G) is different from the so called primal graph PG 
of H(<7), which contains an edge for all pairs of vertices that jointly occur in some hyperedge 
of H(G). In general, G(Q) is much simpler than PG. For instance, consider a game Q with 
a player p that depends on all other players q\, . . . , q n , while these players are independent 
of each other (but possibly depend on p). Then, G{Q) is a tree. However, the primal graph 
of H(C/) is a clique with n + 1 vertices. 

Example 2.4 The hypergraph H(FRIENDS), the graph G(FRIENDS) and the primal 
graph of H(FRIENDS) are shown in Figure 5. Note that the dependency graph associ- 
ated with the FRIENDS game is not acyclic, even though the associated hypergraph is 
acyclic (on the right, we also report a join tree for it). Moreover, note that the dependency 
graph differs from the primal graph, as player P is not a neighbor of R and viceversa. □ 



3. Hard Games 

In this section, we precisely characterize the complexity of deciding the existence of the 
different kinds of pure Nash equilibria (regular, Pareto, and strong). This way, we are able 
to identify the sources of complexity of such problems, in order to single out, in the following 
sections, some natural and practically relevant tractable cases. 

Every game considered in this section is assumed to be either in general or in graphical 
normal form. Indeed, as we shall discuss in details in Section 4, for games in standard 
normal form, computing pure Nash equilibria is a tractable problem, since one can easily 
explore the (big) table representing the utility functions of all players, in order to detect 
the strategy of interest. Since this table is given in input, such a computation is trivially 
feasible in polynomial time. 

We start by showing that deciding the existence of a pure Nash equilibrium is a difficult 
problem, even in a very restricted setting. 
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Figure 6: Schema of the reduction in the proof of Theorem 3.1. 

Theorem 3.1 Deciding whether a game Q has a pure Nash equilibrium is "NP-complete. 
Hardness holds even if Q is in GNF and has 3-bounded neighborhood, and the number of 
actions is fixed. 

Proof. Membership. We can decide that M£{Q) ^ by guessing a global strategy x and 
verifying that x is a Nash equilibrium for Q. The latter task can be done in polynomial 
time. Indeed, for each player p and for each action a G Act(p), we only have to check that 
choosing the strategy p a does not lead to an increment of u p , and each of these tests is 
feasible in polynomial time. 

Hardness. Recall that deciding whether a Boolean formula in conjunctive normal form 
$ = c\ A . . . A c m over the variables X\, ■ ■ ■ ,X n is satisfiable, i.e., deciding whether there 
exists truth assignments to the variables making each clause Cj true, is the well known 
NP-complete problem (CNF) SAT. Hardness holds even for its 3SAT restriction where each 
clause contains at most three distinct (possibly negated) variables, and each variable occurs 
in at most three clauses (Garey & Johnson, 1979). W.l.o.g, assume <3? contains at least one 
clause and one variable. 

We define a GNF game Q such that: The players are partitioned into two sets P v and P c , 
corresponding to the variables and to the clauses of respectively; for each player c 6 P c , 
Neigh(c) is the set of the players corresponding to the variables in the clause c, and for 
each player v € P v , Neigh(v) is the set of the players corresponding to the clauses in which 
v occurs; {t, f, u} is the set of possible actions for all the players, in which t and / can be 
interpreted as the truth values true and false for variables and clauses. Figure 6 shows the 
graph G(Q) for the game Q associated with the formula [X\ V X% V X4) A {—'X2 V X4) A 
(X 4 VX 5 VX 6 ). 

Let x be a global strategy, then the utility functions are defined as follows. For each 
player c € P c , her utility function u c is such that 

(i) ii c ( x ) = 3 if c plays t, and all of her neighbors play an action in {t, /} in such a way 

that at least one of them makes the corresponding clause true; 

(ii) u c (x) = 2 if c plays u, and all of her neighbors play an action in {t, /} in such a way 

that none of them makes the corresponding clause true; 

(iii) -u c (x) = 2 if c plays / and there exists v € Neigh(c) such that v plays u; 

(iv) u c (x) = 1 in all the other cases. 
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For each player v G P v , her utility function u v is such that 

(v) u v (x) = 3 if v plays an action in {t, /} and all of her neighbors play an action in {t, /}; 

(vi) u v (x) = 2 if v plays u and there exists c G Neigh(v) such that c plays u; 

(vii) u„(x) = 1 in all the other cases. 

We claim: is satisfiable 44> Q admits a Nash equilibrium. 

(=>) Assume $ is satisfiable, and take one of such satisfying truth assignments, say a. 
Consider the global strategy x for Q where each player in P v chooses the action according 
to a, and where each player in P c plays t. Note that, in this case, all players get payoff 3 
according to the rules (i) and (v) above, and since 3 is the maximum payoff, x is a Nash 
equilibrium for Q. 

(<=) Let us show that each Nash equilibrium x for Q corresponds to a satisfying truth 
assignment of G. We first state the following properties of the strategies for Q. 

Pi : A strategy x in which a player v G P v plays u cannot be a Nash equilibrium. Indeed, 
assume by contradiction that x is a Nash equilibrium. Then, all c G Neigh(v) must 
play / and have payoff 2, from rule (iii); otherwise they would get payoff 1, by rule (iv). 
However, in this case player v gets payoff 1 from rule (vii), and thus, from rule (v), 
she can easily increase her payoff to 3 by playing an action in {t, /}. Contradiction. 

P2 : A strategy x in which a player c G P c plays u cannot be a Nash equilibrium. Indeed, 
if there is such a player c that chooses u, then from rule (vi) each variable player 
v G Neigh(c) must play u, in order to get her maximum possible payoff 2 for the case 
at hand. Therefore, x cannot be a Nash equilibrium, by property Pi above. 

P3 : A strategy x in which all players play an action in {t, /} and the corresponding truth 
assignment makes a clause c false cannot be a Nash equilibrium. In fact, in this case, 
from rule (ii), c should play u in order to get its maximum possible payoff 2, and 
hence x is not a Nash equilibrium, by property P2. 

P4 : A strategy x in which all players play an action in {t, /} and there exists a player c G P c 
that plays f cannot be a Nash equilibrium. Indeed, if x is a Nash equilibrium and all 
players play an action in {t, /}, by property P3 the truth assignment corresponding to 
this strategy satisfies each clause c. It follows that a player c that plays / contradicts 
the assumption that x is a Nash equilibrium, because c could change her choice to t, 
improving her payoff to 3. 

From these properties, it follows that every Nash equilibrium of Q should be a strategy 
where all players play either t or / and all players corresponding to clauses must play t and 
get payoff 3, as they are all made true by the truth assignment of their neighbors. 

Combined with the "=>"-part, this entails that there is a one-to-one correspondence 
between satisfying truth assignments to the variables of <E> and Nash equilibria of the game Q. 

Finally, observe that the tables (matrices) representing the entries of the utility func- 
tions (rules (i)-(vii) above) can be built in polynomial time from <I>. Moreover, from the 
assumptions that we made on the structure of each player depends on 3 other players 
at most. □ 
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It is worthwhile noting that, though quite limited, in the above proof the interaction 
among players is rather complicated. In particular, it is easy to see that the dependency 
graph of the game described in the hardness part of the proof is cyclic. Thus, one may 
wonder if the problem is any easier for games with simple structured interactions. We next 
show that, in the general setting, even if the structure of player interactions is very simple, 
the problem of deciding whether pure Nash equilibria exist remains hard. 

Theorem 3.2 Deciding whether a game Q in general form has a pure Nash equilibrium is 
NP -complete, even if both its dependency graph and its associated hypergraph are acyclic, 
and the number of actions is fixed. 

Proof. Membership follows from the previous theorem. We next prove that this problem is 
NP-hard, via a reduction from SAT. Given a Boolean formula <I> over variables X\, ...,X m , 
we define a game Q with m players X\, X m corresponding to the variables of <3?, and two 
additional players T and H. Any player JQ, 1 < i < m, has only two available actions, t and 
/, corresponding to truth assignments to the corresponding variable of <£. Moreover, the 
utility function of each player X; L is a constant, say 1. Hence, the choice of X{ is independent 
of any other player. 

The actions of player T are s and u, which can be read "satisfied" and "unsatisfied," 
while the actions of player H are g and b, and can be read "good" and "bad," respectively. 
The role of T is to check whether the actions chosen by X\ , . . . , X m encode a satisfying truth 
assignment for <£. Indeed, their behaviors - described below - ensure that only strategies 
where T plays s may be Nash equilibria, because of her interaction with player H, whose 
role is to discard bad strategies. Given a combined strategy x for the "variable players" 
X\, ...,X m , we denote by $(x) the evaluation of <J> on the truth values determined by the 
strategy x. 

Player T depends on the players in {X\, . . . ,X m ,H}, and her utility function is defined 
as follows. For any combined strategy y = xi U X2 for X±, . . . , X m , H, T, where xi is 
a combined strategy for X\, ...,X m and X2 for T and H: 

• u t{y) = 1 if 3>(xi) is true and T plays s, or 3>(xi) is false and X2 = {T u , H g }, or 
<5(xi) is false and x 2 = {T s ,Hb}; 

• u T(y) = 0, otherwise. 

Player H depends only on T and, for any combined strategy x for H and T, her utility 
function is the following: 

• ujf(x) = 1 if x is either {T s ,H g } or {T u , H b }; 

• uh(x) = 0, otherwise. 

We claim there is a one-to-one correspondence between Nash equilibria of this game 
and satisfying assignments for Indeed, let 4> be a satisfying assignment for $ and x^ the 
combined strategy for X\ , . . . , X m where these players choose their actions according to (j>. 
Then, x<p U {T s ,H g } is a Nash equilibrium for Q, because all players get their maximum 
payoff. 
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On the other hand, if <1> is unsatisfiable, for any combined strategy xi for X\, . . . ,X m , 
$(xi) is false. In this case, T and H have opposite interests and it is easy to check that, for 
each combined strategy X2 € St({H, T}), xi U X2 is not a Nash equilibrium for Q, because 
either H or T can improve its payoff. 

Finally, observe that the dependency graph G(Q) is a tree, and that the hypergraph 
H(G) is acyclic. □ 

As shown in Figure 2, the above NP-hardness result immediately extends to all gener- 
alizations of acyclicity. The case of acyclic-hypergraph games in GNF will be dealt with in 
Section 4. 

Let us now draw our attention to Pareto equilibria. By Definition 2.2, a Pareto Nash 
equilibrium exists if and only if a Nash equilibrium exists. Therefore, from Theorems 3.1 
and 3.2, we get the following corollary. 

Corollary 3.3 Deciding whether a game Q has a Pareto Nash equilibrium is NP-complete. 
Hardness holds even if Q has a fixed number of actions and if either Q is in graphical normal 
form and has k-bounded neighborhood, for any fixed constant k > 3, or if both G(Q) and 
H(C/) are acyclic. 

However, while checking whether a global strategy x is a pure Nash equilibrium is 
tractable, it turns out that checking whether x is a Pareto Nash equilibrium is a compu- 
tationally hard task. In fact, we next show that this problem is as difficult as checking 
whether x is a strong Nash equilibrium. However, we will see that deciding the existence of 
a strong Nash equilibrium is much harder, and in fact complete for the second level of the 
Polynomial Hierarchy. To this end, in the following proofs, we associate quantified Boolean 
Formulas having two quantifier alternations (2QBFs) with games. 

Quantified Boolean Formulas (QBFs) and games. Let 

S = 3ai,...a n Vft,...ft $ 

be a quantified Boolean formula in disjunctive normal form, i.e., $ is a Boolean formula of 
the form d\ V. . . V<i m over the variables cci, . . . a n , ft, . . . ft, where each d\ is a conjunction of 
literals. Deciding the validity of such formulas is a well-known S^-complete problem - (e.g. 
Stockmeyer & Meyer, 1973), and it is easy to see that hardness result holds even if each 
disjunct dj in S contains three literals at most and each variable occurs in three disjuncts 
at most. Moreover, without loss of generality, we assume that the number m of disjuncts is 
a power of 2, say m = 2?, for some integer I > 2. Note that, if 2^ _1 < m < 2 e , then we can 
build in polynomial time a new QBF S' having 2 l — m more disjuncts, each one containing 
both a fresh existentially quantified variable and its negation. Clearly, such disjuncts cannot 
be made true by any assignment, and hence S' is equivalent to S. Hereafter, we will consider 
quantified Boolean formulas of this form, that we call R2QBF. For each such formula S, a 
truth value assignment o~ to the existentially quantified variables oi, . . . , ct n such that the 
formula V ft, ... ft is valid is called a witness of validity for E. 

As a running example for this section, we consider the following QBF E r : 
3aia 2 a 3 Vftftftftft («i A a 2 ) V (ai A a 3 ) V (ai A -.ft) V (ft) V (-ft A -ft) V (ft A ft) V 
(ft Aft) V (ft). 
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Figure 7: On the left: the dependency graph of the game Qu T - On the right: a truth-value 
assignment for H r corresponding to a strong Nash equilibrium of Gs, r . 



We define a GNF game Qs associated with a R2QBF H as follows. The players of Qs 
are partitioned in five sets P e , P u , P<j, Pt, and the singleton {C}. 

Players in P e , P u , and correspond to the existential variables a±, . . . a n , to the univer- 
sal variables /3i, . . . fy, and to the m disjuncts of respectively. Each "variable" player v in 
P e U P u may play a "truth value" action in {T, F} (read: {true, false}), and her neighbors 
are the (at most three) players in Pj corresponding to the disjuncts of where v occurs. 
Each "disjunct" player p may play an action in {T,F,w}, and her neighbors are the (at 
most three) players corresponding to her variables, plus one player belonging to the set 
Pt, as described below. As shown in Figure 7, these disjunct players are the leaves of a 
complete binary tree comprising all players in Pt as intermediate vertices, and the player 
C as its root. In fact, the "tree" players Pt act as logical-or gates of a circuit. For the sake 
of a simpler presentation, for each tree player p, children(p) denotes the set of two players 
that are children of p in this tree, while parent(p) denotes her parent. As for disjunct play- 
ers, the set of available actions for players in Pt is {T,F,w}. Finally, the player C, called 
"challenger," may play actions in {T,w}. As shown in Figure 7, the neighbors of C are the 
two top level tree-players. 

Let x be a global strategy. The utility functions for the players in £/s are defined as 
follows. 

Existential-variables players. For each a £ P e , 

(E-i) u a (x) = 1, no matter of what other players do; 

Universal- variables players. For each j3 € P u , 

(U-i) ug(x) = 2, if there exists a (disjunct) neighbor playing w; 
(U-ii) Uf3(x) = 1 in all other cases. 

Disjuncts players. For each d G Pd, 
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(D-i) tid(x) = 2 if d and her parent (i.e., a node from Pt) both play w, and the 
disjunct of <3? corresponding to d is made false by the truth-value actions in x of 
her variable players, i.e., by the players in Neigh(d) n (P e U P u ); 

(D-ii) Ud(x) = 1 if d plays T and the disjunct of <I> corresponding to d is made true 
by the truth-value actions in x of her variable players; 

(D-iii) Urf(x) = 1 if d plays F, the disjunct of corresponding to d is made false 
by the truth-value actions of her variable players, and her parent node (a tree 
player) does not play w; 

(D-iv) Ud(x) = 0, in all other cases. 
Tree players. For each p G Pt, 

(TREE-i) -Up(x) = 2 if both p and all of her neighbors play w; 

(TREE-ii) u p (x) = 1 if p plays T, none of her neighbors plays w, and some player 
in children(p) plays T; 

(TREE-iii) u p (x) = 1 if p plays F, none of her neighbors plays w, and all players in 
children(p) plays F; 

(TREE-iv) u p (x) = 1 if p plays an action in {T, F}, and some of her neighbors plays 
w, but not all of them; 

(TREE-v) u p (x) = in all other cases. 

Challenger. For player C, 

(CHALL-i) nc(x) = 2 if C plays w, and either both of her neighbors play F, or at 
least one of them plays w; 

(CHALL-ii) uc( x ) = 1 if C plays T, some of her neighbors plays T, and none plays 
w; 

(CHALL-iii) uc(x) = in all other cases. 

Intuitively, universal- variable players corresponding to the variables 0i , . . . (3 q choose 
their actions trying to falsify the formula, since their maximum payoff 2 can be obtained 
only if $ is not satisfied. The strategies of variable players are suitably "evaluated" by 
players in P^ U Pt, and eventually by C. 

It is worthwhile noting that Gz can be built in polynomial time (actually, in LOGSPACE) 
from E, and that each player in Qs may play at most three actions and has a bounded 
number of neighbors. More precisely, for the sake of presentation, in the above construction 
each player has at most four neighbors. However, we will show later in this section how this 
bound can be reduced easily to three. 

Let x be a global strategy for Q-s. We denote by cr(x) the truth-value assignment for 
$ determined by the actions chosen by the variable players (i.e., those in P e U P u ) in the 
strategy x. Moreover, we denote by cr e (x) and <r u (x) its restriction to the existential and 
the universal variables, respectively. 

Lemma 3.4 There is a one-to-one correspondence among the satisfying truth-value assign- 
ments for <3? and the Nash equilibria of where no player plays w. 
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Proof. Assume $ is satisfiable, and let a be a satisfying truth-value assignment for it. 
Consider the following global strategy x CT for Q-=: each variable player in P e L)P u chooses her 
truth-value action according to a; each disjunct player in Pd plays either T or F, depending 
on the logical evaluation of the disjunct associated with her; each tree player p in P t plays 
either T or F, acting as an OR gate having as its input the values played by children (p); 
the player C plays T. Note that no player chooses to in x ff . 

Figure 7 shows on the right the strategy for Ge associated with the truth assignment 
«i = a 2 = a 3 = Pi = T and = 03 = 04 = 05 = F. 

Since a is a satisfying assignment, at least one disjunct of $ will be evaluated to true 
and thus at least one of the tree-player neighbors of C plays T. Therefore, it is easy to 
check that, according to the utility functions of Qz, all players get payoff 1 with respect 
to x CT . In particular, this follows from rule (D-ii) or (D-iii) for disjunct players, from rule 
(TREE-ii) or (TREE-iii) for tree players, and from rule (CHALL-ii) for the player C. 

Moreover, the only rules that may increase some payoff from 1 to 2 are (TREE-i), 
(CHALL-i) and (D-i). However, no single player can increase her payoff by changing her 
action, because all these rules may be applied only if there is some neighbor that is playing 
w, which is not the case in x ff . It follows that the global strategy x CT is a Nash equilibrium 
for g E . 

We next prove the converse, that is, we show that each Nash equilibrium x for where 
no player chooses w corresponds to a satisfying truth-value assignment for <E>. This proof is 
based on the following properties of x: 

Pi : At least one player in Neigh(C) does not play F. Otherwise, C would play w in order 
to get payoff 2, from rule (CHALL-i), contradicting the hypothesis on x. 

P2 : At least one player in Pd plays T. Otherwise, since no player chooses w in x, the only 
possible choice for all disjunct players would be F. However, in this case, the best 
available choice for all tree-players depending on disjunct players in Pd is to play F, 
according to (TREE-iii). It follows by induction that all players in Pt would play F 
and, in particular, all neighbors of C. However, this contradicts property Pi of x. 

P3 : & is satisfied by the truth- assignment c(x). Let p € Pd be a disjunct player that plays 
T, and whose existence is guaranteed by property Pi- From the hypothesis that no 
player chooses w, rule (D-i) is not applicable to p. It follows that the disjunction d 
of corresponding to player p is true with respect to <r(x). Otherwise, x would not 
be a Nash equilibrium, because p would get payoff from (D-iv) and could improve 
it by playing the correct evaluation F, after rule (D-iii). 

Therefore, in case no player chooses w, all global strategies that are Nash equilibria 
correspond to satisfying assignments for <I>. □ 

Lemma 3.5 A Nash equilibrium x for where no player chooses w is strong if and only 
if a e (x) is a witness of validity for S. 

Proof. (=>) Assume x is a strong Nash equilibrium for where no player chooses w. 
Then, <r(x) satisfies <£, from the previous lemma. Assume by contradiction that <r e (x) is 
not a witness of validity for S. Then, there is an assignment a' u for the universal variables 
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such that is not satisfied with respect to cr e (x) U o' u . Let K be the coalition comprising 
all players in £/= but the existential players in P e , and let y be the combined strategy for K 
such that all universal players in P u choose their truth- value action according to a' u , and all 
the other players in K play w. By the choice of a' u , all the disjuncts are made false via the 
truth-value actions chosen by players in P u . Then, from rule (D-i), all disjunct players get 
payoff 2 according to x_^[y]. Similarly, from (Tree-i) and (Chall-i), all tree-players and the 
player C get payoff 2 in x_#[y]. However, this means that all players in the coalition arc 
improving their payoff, and this contradicts the fact that x is a strong Nash equilibrium. 

(<=) Assume that S is valid and let <r(x) be a satisfying truth-value assignment for $ 
such that <J e (x) is a witness of validity for S, for some Nash equilibrium x for Q-=. Indeed, 
from Lemma 3.4 we know such an equilibrium (where no player plays w) exists for every 
satisfying assignment, and that no player chooses w in x. Moreover, it is easy to check that 
all players get payoff 1, according to this global strategy. Assume by contradiction that x is 
not a strong Nash equilibrium for Then, there is a coalition K and a combined strategy 
y for K such that all players in the coalition may improve their payoff in the global strategy 
x_R-[y], and hence they get payoff 2 in this strategy. Note that no existential player may 
belong to K and thus change her action, because there is no way for her to improve her 
payoff. Then, from rule (Tree-i), the only way for players in P$ to improve their payoff to 2 
is that all of them change their actions to w, because all these rules require that, for each 
player, all of her neighbors play w. Thus, if one of them belongs to K, then all of them 
belong to this coalition, as well as player C and all the disjunct players in P^, that are their 
neighbors and should change her choices to w in order to get 2, too. On the other hand, 
for all disjunct players p in Pj, this improvement to 2 depends also on the variable players 
occurring in the disjunct of <I> associated with p (D-i). In particular, besides playing w, this 
disjunct should also be made false, because of some change in the choices of the universal 
players p depends on. Note that such players may in turn improve their payoff to 2, if p plays 
w. It follows any coalition K that shows x is not a Nash equilibrium contains a number of 
universal players that are able to let all the disjunct players to be unsatisfied and hence to 
change their actions to w, thus getting payoff 2. However, the truth-values corresponding 
to the actions of players in P u n K determine an assignment <j' u that contradicts the validity 
of S. □ 



Theorem 3.6 Given a game Q and a global strategy x, deciding whether x G SN£{Q) 
(resp., x € VN£{Q)) is co-NP -complete. Hardness holds even if the given strategy x is a 
pure Nash equilibrium, Q is in graphical normal form and has 3-bounded neighborhood, and 
the number of actions is fixed. 

Proof. Membership. Deciding whether x ^ VN£(G) is in NP: (i) check in polynomial 
time whether x ^ M£{Q); (ii) if this is not the case, guess a global strategy y and check 
in polynomial time whether y € N£{Q) and y dominates x. Similarly, deciding whether 
x SM£{Q) is in NP: (i) check in polynomial time whether x Af£(Q); (ii) if this is not 
the case, guess a coalition of players K and a combined strategy y for the players in K, 
and check in polynomial time whether all the players in K increase their payoff by playing 
their actions according to the new strategy y. 
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Figure 8: Transformation of a disjunct containing exactly three literals. 



Hardness. It is well-known that checking whether a satisfiable formula in 3DNF is tau- 
tologically valid is co-NP complete. We reduce this problem to the problem of checking 
whether a given Nash equilibrium is strong (Pareto). Let $ be a satisfiable formula in 
3DNF. Find a satisfying truth value assignment a for <F This is obviously possible in 
polynomial time, given that <I> is satisfiable and in DNF. Define H = V/?i, . . . (3 q S can 
be considered a (degenerate) R2QBF without existentially quantified variables. Let Qs be 
the game associated with S. Obviously, Qs can be constructed in polynomial time from 
<]?. Let x be the Nash equilibrium for Q-= determined by this truth- value assignment where 
no player chooses w, as described in Lemma 3.4, and note that even this equilibrium can 
be computed in polynomial time from a. Then, by Lemma 3.5, x is strong if only if $ is 
valid (i.e., the vacuous assignment a e is a witness of validity). This settles the hardness of 
checking whether a given Nash Equilibrium is strong. In addition, it is not hard to see that 
in the above construction x is a Pareto equilibrium for Ge if and only if $ is a tautology. 
Indeed, note that, there is a truth- value assignment a 1 that falsifies <£, if and only if there 
is a global strategy y where (universal) variable players play according to a 1 and all other 
players choose w, such that y dominates the Nash equilibrium x. Thus checking whether a 
given Nash equilibrium is Pareto is co-NP complete, too. 

We conclude the proof by observing that, in our reduction, each player in P e U P u U Ft U 
{C} depends on three other players at most, but some player d in Pj may depend on four 
other players, if the corresponding disjunct contains exactly three literals. In this case, we 
may introduce an additional player d! whose set of actions is {T, F, w} and whose neighbors 
are the first two literals plus d. Moreover, her utility function is such that d! acts as an 
AND-gate on the inputs of the literals, preferring w if the two literals are evaluated false, or 
if d plays w. In this new encoding, d depends only on d' and on the third literal occurring 
in the disjunct. As for the basic construction previously defined, her payoff is 2 if she plays 
w, her parent plays w, and the third literal is false, or if d' plays w. Figure 8 shows this 
transformation. Note that this construction preserves all the properties proved so far, and 
each player depends on three other players at most. □ 

Deciding whether a game has a strong Nash equilibrium turns out to be much more 
difficult than deciding the existence of pure (Pareto) Nash equilibria. Indeed, this problem 
is located at the second level of the polynomial hierarchy. 

Theorem 3.7 Given a game Q, deciding whether Q has a strong Nash equilibrium is S^- 
complete. Hardness holds even if Q is in graphical normal form and has 3-bounded neigh- 
borhood, and the number of actions is fixed. 
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Proof. Membership. We can decide that SM£{Q) ^ by guessing a global strategy x and 
verifying that x is a strong Nash equilibrium for Q. From Theorem 3.6, the latter task is 
feasible in co-NP. It follows that the problem belongs to . 

Hardness. Let E = 3a\, . . . a n V/3i, . . . [3 q <& be a R2QBF. Recall that deciding the validity 
of such formulas is a X^-complete problem - see the definition of R2QBF above, in the 
current section. 

We define a game G' E associated with S, obtained from with the addition of one 
more gadget. In there is a fresh player D depending on the player C only. It is called 
"duplicator," because D gets her maximum payoff if she plays the same action as the 
challenger player C. On the other hand, also C depends on this new player D, besides her 
other tree-players neighbors (recall the construction shown in Figure 7). Both C and D 
play actions in {T, w,u}. Everything else is the same as in £/=, but for the utility functions 
of players C and D: 

Challenger. For player C, 

(CHALL-i) iic(x) = 2 if C and D play different actions in {w,u} and either all of 
her tree-players neighbors (i.e., the players in Neigh(C) — {D}) play F, or at 
least one of them plays w; 

(CHALL-ii) uc(x) = 1 if C plays T, one player in Neigh(C) - {D} plays T, and 
none plays w; 

(CHALL-iii) uc(x) = in all other cases. 

Duplicator. For player D, 

(DUPL-i) ud(x) = 1 if D plays the same action as C; 
(DUPL-ii) uo(x) = in all other cases. 

Recall that, in order to maximize their payoffs, the universal-variable players try to 
make <3? false, and that the strategies of variable players are suitably "evaluated" by players 
in P<i U Pt, acting as a Boolean circuit. Moreover, the challenger and the duplicator are 
designed in such a way that strategies where some player chooses w, which do not correspond 
to satisfying assignments for <I>, cannot lead to Nash equilibria. Formally, for any Nash 
equilibrium of the following properties hold. 

Pi : At least one player in Neigh(C) — {D} does not play F and no player in Neigh(C) — {D} 
plays w. Otherwise, C would play an action in {w,u} different from the one played 
by D in x, in order to get payoff 2, from rule (CHALL-i). However, such a strategy 
cannot be an equilibrium, because D could improve her payoff by choosing the same 
action as C in x. 

Pi : If a player in Pj U Pt plays w then all players in P^ U Pt play w. Indeed, let p be 
a player in Pd U Pt playing w and assume by contradiction that there is a player q 
in Pd U Pt that does not play w. W.l.o.g., we can assume that q G Neigh(p) and 
viceversa. Then, p gets payoff 0, but could increase her payoff by playing an action in 
{T, F} according to (D-ii) or (D-iii) for players in P^, and to (TREE-ii), (TREE-iii) 
or (TREE-iv) for players in Pt. This contradicts the fact that x is a Nash equilibrium. 
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P3 : No player in P^ U P± plays w. Otherwise, from P2, all players in Pj U Pt play w and, 
in particular, the players in Neigh(C) — {D}. However, this is not possible, after 
property P\. 

Therefore, rule (Chall-i) is not applicable for C with respect to x. However, from the 
above properties at least one of her tree-players neighbors should play T and C can play T 
in her turn and get payoff 1, from rule (Chall-ii). Then, D may play T and get payoff 1, as 
well. Thus, it is no longer possible to have a Nash equilibrium with some player choosing 
the action w. Therefore, after Lemma 3.5 (as the presence of the duplicator does not affect 
that proof), we get the following fundamental result: a global strategy x is a strong Nash 
equilibrium for if and only if the truth- value assignment <T e (x) is a witness of validity 
for S. In particular, SAf£(G~) 7^ if and only if S is valid. 

Finally, observe that even the game Q' s can be modified as shown in Figure 8, in order 
to get a 3-bounded neighborhood game. □ 

We next show that, if the game is given in general form, the above hardness result holds 
even if the structure of player interactions is very simple. 

Theorem 3.8 Deciding whether a game Q in general form has a strong Nash equilibrium 
is £2 -complete, even if both its dependency graph and its associated hypergraph are acyclic, 
and the number of actions is fixed. 

Proof. The proof of membership in is t ne same as the membership proof in the previous 
theorem. We next prove that this problem is hard for Sf. 

Let E = 3a\, ... a n y Pi, ... (3 q be a quantified Boolean formula in disjunctive 
normal form. We define a game Gs with m players a±, . . . a n , Pi, . . . P q corresponding to 
the existentially and universally quantified variables of E, and two additional players T and 
H. The game is based on a combination of the game techniques exploited in the proofs of 
Theorem 3.2 and Theorem 3.7. Any player associated with a variable has only two available 
actions, t and /, which represent truth assignments to the corresponding variable of the 
actions of player T are s and u, which can be read "satisfied" and "unsatisfied," while the 
actions of player H are g and b, and can be read "good" and "bad," respectively. 

Given a combined strategy x, we denote by $(x) the evaluation of $ on the truth values 
determined by the strategy x. Then, the utility functions are defined as follows. Any player 
ol\ (1 < i < n) gets always payoff 1. Any player Pj (1 < j < q) depends on T and gets 
payoff 1 if T plays s in x, and payoff 2 if T plays u in x. Player H depends only on T and 
gets payoff 1 if x contains either {T s ,H g } or {T u ,Hi,}, and 0, otherwise. Finally, player T 
depends on players in {ai, . . . a n , P\, . . . P q , H}, and her utility function is defined as follows: 

• ity(x) = 2, if 3>(x) is false, T plays u, and H plays g; 

• «t(x) = 1, if 3>(x) is true and T plays s, or if 3>(x) is false, T plays s, and H plays b; 

• mt(x) = 0, otherwise. 

First, observe that both the dependency graph and the dependency hypergraph of Gs 
are acyclic. Moreover, after the proof of Theorem 3.2, it is easy to see that there is a one- 
to-one correspondence between Nash equilibria of this game and satisfying assignments for 
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Then, for any Nash equilibrium x for we denote by cr x its corresponding truth- value 
assignment, and by tr* the restriction of this assignment to the existential variables of S. 
Note that, as shown in the above mentioned proof, at any Nash equilibrium, player T plays 
s and all players in the game get payoff 1. 

We next prove that any witness of validity for S corresponds to a strong Nash equi- 
librium for Qz. Let x be a Nash equilibrium and consider a coalition K of players that 
deviate from x, leading to a new profile x'. From the definition of the game, the only way 
for the coalition to get a payoff higher than 1 is that T changes her choice to u. In this 
case, if $(x') is false (and H plays g), T will get payoff 2. Since <3? is true with respect to 
x, it follows that some variable players have to change their choices, which means that they 
should belong to the coalition and improve their payoffs. Therefore, all variable players 
in K should correspond to universally quantified variables, as only these players are able 
to improve their payoffs from 1 to 2. Thus, such a coalition K exists if and only if the 
universally quantified variables can make the formula false, that is, a* is not a witness of 
validity for S. Equivalently, it follows that x is a strong Nash equilibrium if and only if E 
is valid. □ 



Remark 3.9 Recall that we assumed any general game Q to be taken from the class C^. 

It is worthwhile noting that, for games without restriction on player interactions, our 
hardness results hold for games where the utility functions are computable in constant time, 
too. Namely, consider Theorems 3.1, 3.6, and 3.7. In these constructions, each player has 
at most three neighbors and a fixed number of actions. Therefore, the utility function of 
each player is computable in constant time. 

4. Easy Games 

Before we deal with tractable games in graphical normal form (GNF), let us recall that 
all computational problems dealt with in this paper are tractable for games in standard 
normal form (SNF), even for arbitrary interactions among players. Actually, we next point 
out that they can be carried out in logarithmic space and are thus in a very low complexity 
class that contains highly parallelizable problems only. This is not very surprising, because 
in fact the size of SNF games may be exponentially larger than the size of the same games 
encoded in GNF. 

Theorem 4.1 Given a game in standard normal form, the following tasks are all feasible 
in logarithmic space: Determining the existence of a pure Nash equilibrium, a pure Pareto 
equilibrium, or a strong Nash equilibrium, and computing all such equilibria. 

Proof. Let P, as usual, denote the set of players. We assume w.l.o.g. that each player has 
at least two possible actions (in fact, a player with a single action can be eliminated from 
the game by a simple logspace transformation, yielding an equivalent game). The size of 
the input matrix is thus at least 2l p L 

Given that all possible global strategies are explicitly represented, each corresponding 
to a table cell (which can be indexed in logarithmic space in the size of the input, which 
corresponds to polynomial space in \P\ x \A\, where P and A are the sets of players and the 
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set of all possible actions, respectively), the Nash equilibria are easily identified by scanning 
(i.e., enumerating) all global strategies x keeping a logspace index of x on the worktape, 
and checking in logarithmic space (in the size of the input) whether no player can improve 
her utility by choosing another action. Given that all Nash Equilibria can be generated in 
logarithmic space, they also can be generated in polynomial time. 

The Pareto equilibria can be identified by successively enumerating all Nash equilibria 
x, and by an additional loop for each x, enumerating all Nash equilibria y (indexed in 
logarithmic space as above) and outputting x if there is no y such that, Vp G P, u p (y) > 
u p (x). The latter condition can be tested by means of a simple scan of the players. 

Strong Nash equilibria can be identified by enumerating all Nash equilibria and by scan- 
ning all possible coalitions of the players (which can be indexed in logarithmic space, as 
their number is 2l p l) in order to discard those equilibria x for which there exists a coalition 
K C P and a combined strategy y for K, such that for each p G K, u p (x) < it p (x_K-[y]). 
Finally, note that, for a fixed coalition K, the enumeration of all the combined strategies y 
for K can be carried out by means of an additional nested loop, requiring logarithmic space 
for indexing each such strategy. □ 



4.1 Constraint Satisfaction Problems and Games in Graphical Normal Form 

Let us now consider games in GNF. We first establish an interesting connection between 
constraint satisfaction problems and games. An instance of a constraint satisfaction problem 
( CSP) (also constraint network) is a triple / = ( Var, U, C), where Var is a finite set of vari- 
ables, U is a finite domain of values, and C = {C\, C2, ■ ■ ■ , C q } is a finite set of constraints. 
Each constraint Cj is a pair (S^r-j), where Si is a list of variables of length mj called the 
constraint scope, and r*j is an mj-ary relation over U, called the constraint relation. (The 
tuples of 7~j indicate the allowed combinations of simultaneous values for the variables Si). 
A solution of a CSP instance is a substitution 9 : Var — ► U, such that for each 1 < i < q, 
SiO G ri. The problem of deciding whether a CSP instance has any solution is called con- 
straint satisfiability ( CS). Since we are interested in CSPs associated with games, where 
variables are players of games, we will use interchangeably the terms variable and player, 
whenever no confusion arises. 

Let Q = (P, Neigh, A, U) be a game and p G P a player. Define the Nash constraint 
NC(p) = (S p , r p ) as follows: The scope S p consists of the players in {p} U Neigh(p), and the 
relation r p contains precisely all combined strategies x for {p} U Neigh(p) such that there 
is no y p G St(p) such that u p (x) < w p (x_ p [y p ]). Thus note that, for each Nash equilibrium 
x of Q, x n St(Sp) is in r p . 

The constraint satisfaction problem associated with Q, denoted by CSP(Q), is the triple 
(Var,U,C), where Var = P, the domain U contains all the possible actions of all players, 
and C = {NC(p) | p G P}, i.e., it is the set of Nash constraints for the players in Q. 

Example 4.2 The constraint satisfaction problem associated with FRIENDS game is 
({F, G, R, P, M}, {m, o},C), where the set of constraints contains exactly the following Nash 
constraints: NC(F) = {{F, P, R},r F ), NC(G) = ({G, P, F}, r G ), NC{R) = ({R,F},r R ), 
NC(P) = ({P, F}, rp), and NC(M) = ({M, R}, tm), where the constraint scopes are shown 
in Figure 9. □ 
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Figure 9: Constraint relations of the game FRIENDS in Example 2.1. 



The structure of a constraint satisfaction problem / = (Var, U,C) is represented by the 
hypergraph H(7) = (V, H), where V = Var and H = {var(S) j C = {S, r) £ C}, and var(S) 
denotes the set of variables in the scope S of the constraint C . Therefore, by definition 
of CSP{Q), the hypergraph of any game Q coincides with the hypergraph of its associated 
constraint satisfaction problem, and thus they have the same structural properties. 

The following theorem establishes a fundamental relationship between games and CSPs. 

Theorem 4.3 A strategy x is a pure Nash equilibrium for a game Q if and only if it is a 
solution of CSP(G). 

Proof. Let x be a Nash equilibrium for Q and let p be any player. Then, for each strategy 
p a € St(p), u p (x) > iip(x_ p [p a ]). Since u p depends only on the players in {p} U Neigh(p), 
their combined strategy x' C x is a tuple of NC(p), by construction. It follows that the 
substitution assigning to each player p its individual strategy p a <G x is a solution of CSP(Q). 

On the other hand, consider any solution 9 of CSP{Q), and let p be any player. Let 
P' = {p} U Neigh(p) and x' the combined strategy {0(q) \ q G P'}. Then, x' is a tuple 
of NC(p), because 6 is a solution of CSP(Q). Thus, for each p, by definition of NC(p), 
there is no individual strategy for p that can increase her utility, given the strategies of the 
other players. It follows that the global strategy containing 6(p) for each player p is a Nash 
equilibrium for Q. □ 

The following theorem states the feasibility of the computation of CSP(Q). 

Theorem 4.4 Let Q be a game having small neighborhood or in graphical normal form. 
Then, computing CSP(Q) is feasible in polynomial time. 

Proof. Let Q = (P, Neigh, A, U) be a game having small neighborhood. We show that 
NC{p) = {S p , r p ) can be computed in polynomial time. We initialize r p with all the com- 
bined strategies for {p} U Neigh(p). The number of these combined strategies is bounded 
by 

maxAct(g)\ Nei9h(p)l = 2 Xo ^ maxAct ^ NewHp) ^ < 2 t(G ^ xlo ^ G ^ = \\G\\ i(G) , 
where the intricacy i{Q) of Q is given by 

maxNeigh{Q) x log maxAct{Q) 



383 



Gottlob, Greco, and Scarcello 



Function NashE valuation ( JT : join tree of H(S)): Boolean 



begin 

Bottom-Up(JT); 

let v = (S v ,r v ) be the root of JT; 
if r v = then return false; 
else 



Top-Down( JT); 
Select-equilibrium( JT); 
output JT; 
return true; 



end; 



Procedure Bottom-Up(var T : tree) 



Procedure Top-Down(var T : tree) 



begin 

Done := the set of all the leaves of T; 
while 3d € T such that 



begin 



for each c = (S c ,r c ) child of v do 

Vc ■— K Ty ; 

let T c be the subtree of T rooted at c; 
Top-Down(T c ); 



let v = (S v , r v ) be the root of T; 



(i) v £ Done, and 

(ii) {c | c is child of v} C Done do 
for each c = (&, r c ) child of v do 

r v := v v K 7* c ; 



end for 
end; 



Done := Done U {v}; 
end while 



end; 



Figure 10: Evaluation of an acyclic game. 



Since Q has small neighborhood, i{Q) is bounded by some constant, and thus the set of all 
combined strategies for p is polynomially bounded. The initialization process computes for 
each p all corresponding combined strategies (via a simple enumeration), and thus takes 
polynomial time (in the size of Q). 

Now, for each tuple x in r p we have to check whether it should be kept in r p or not. Let 
m = u p (x). For each action a € Act(p), compute in polynomial time m! = u p (x-p[p a ]) and 
delete x if m' > m. It follows that CSP{Q) can be computed in polynomial time from Q. 

A similar line of reasoning applies if Q is in GNF. In this case, the utility functions are 
explicitly given in input in a tabular form, and thus the computation of Nash constraints 
is yet easier. In fact, this task is feasible in logspace for GNF games. □ 

After Theorem 4.3, an acyclic-hypergraph game Q having small neighborhood or in 
graphical normal form can be solved in polynomial time. Indeed, Q and CSP{Q) have the 
same hypergraph and, as shown by Gottlob et al. (2000), a solution of an acyclic constraint 
satisfaction problem can be computed by (a slight adaptation of) the well known Yan- 
nakakis's algorithm for evaluating acyclic conjunctive queries (Yannakakis, 1981), or by the 
LOGCFL algorithm proposed by Gottlob et al. (2000), which shows this problem is highly 
parallelizable — see Section 6, for more information on the complexity class LOGCFL. For 
the sake of completeness, in Figure 10, we report an algorithm for deciding the existence of 
a Nash equilibrium and for computing Nash equilibria of acyclic-hypergraph games, based 
on these results. We assume the reader is familiar with typical database operations like 
semi-joins (for more details, see, e.g., Maier, 1986). 

The algorithm takes in input a join tree JT of H(G). With a small abuse of notation, 
each vertex of JT, which is formally a hyperedge H v associated with a player v, is also 
used to denote the player herself as well as the Nash constraint (S v ,r v ) associated with v. 
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Procedure Select-equilibrium (var T : tree) 
begin 

let v = {S v ,r v ) be the root of T; 

select any combined strategy t v 6 r v s.t. \/t' v 6 r„, < u v (t v ); 

delete all tuples in r v , but t v ; 
for each c = (5 c ,r c ) child of v do 

7*c • — ^ i 

let T c be the subtree of T rooted at c; 
Select-equilibrium(T c ); 
end for 
end; 



Figure 11: Selection of a (Pareto) Nash equilibrium of an acyclic game. 

The algorithm consists of two phases. In the first bottom-up phase, the constraint relation 
r v of each node v = (S v ,r v ) of JT is filtered by means of a semijoin with the constraint 
relation r c (denoted by r v x r c ) of each of her children c in JT. This semijoin eliminates 
all tuples from r v corresponding to combined strategies of the players in P' = (Neigh(c) U 
{c}) (~l (Neigh(v) U {v})) that are not available (or no longer available) in r c . 

This way, all tuples corresponding to strategies that do not match and hence cannot lead 
to Nash equilibria are deleted, starting from the leaves. Finally, either the root is empty and 
hence Q does not have equilibria, or the tuples remaining in the root p encode the strategies 
that p may choose in Nash equilibria of the game. In the top-down phase, this property 
of the root is propagated down the tree by taking the semi-join of every vertex with all its 
children. At the end, we get a tree such that all tuples encode strategies belonging to Nash 
equilibria and, vice versa, all Nash equilibria are made from strategies in the relations stored 
in JT. Then, by standard techniques developed for acyclic database queries and CSPs, we 
can compute from JT all Nash equilibria of Q in a backtrack-free way, and thus in time 
polynomial in the combined size of the input game and of the equilibria in output. Note 
that this is the best we can do, as a game may have an exponential number of equilibria. 

For completeness, Figure 11 shows Procedure Select- equilibrium, that selects from JT 
one Nash equilibrium. It is very similar to Procedure Top-Down, but for the selection step 
before semi-joins: for any vertex, Select- equilibrium first picks a combined strategy t v £ r v , 
deletes all other tuples in r v , and then performs the semi-joins with its children and calls 
itself recursively, to propagate the choice of t v towards the leaves of the tree. Note that the 
selection of t v may be arbitrary, after the previous bottom-up and top-down steps. However, 
in Figure 11 we select strategies giving the best payoffs, in order to get a Nash equilibrium 
that cannot be dominated by any other Nash equilibrium. 

Theorem 4.5 Deciding the existence of pure Nash equilibria, as well as computing a Nash 
equilibrium is feasible in polynomial time for all classes C of acyclic- hypergraph games such 
that every game Q G C has small neighborhood or is in graphical normal form. 

From the above discussion, it immediately follows that this tractability result can be 
extended to the problem of computing a Pareto Nash equilibrium. 

Theorem 4.6 Deciding the existence of Pareto Nash equilibria, as well as computing a 
Pareto Nash equilibrium for pure strategies is feasible in polynomial time for all classes C 
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Function InCoalition x> jt (H p : vertex, st: combined strategy): boolean 
begin 

let (S p ,r p ) be the constraint associated with player p and A r+ = {p} U Neigh(p); 

guess a tuple st' £ r p such that st' matches st on the players they have in common; 

if p's strategy in st' is different from her strategy in x and u p (x_ N + [st']) < u p (x) then 

return false; 
else 

let K p be the set of children of H p in the join tree JT; 
if K p = then 

return true; 
else 

return f\ H / eKp InCoalition Xj jt(H p i ,st'); 

end if 
end. 



Figure 12: Algorithm for deciding the existence of a coalition improving x. 

of acyclic-hypergraph games such that every game Q € C has small neighborhood or is in 
graphical normal form. 

Proof. Recall that Procedure Select- equilibrium in Figure 11, at each vertex v encountered 
during the visit of JT, select a combined strategy that guarantees to the player correspond- 
ing to v the maximum payoff over the available choices (that, at this point, are all and 
only those strategies that may lead to Nash equilibria). In particular, the payoff of the first 
player to be evaluated, say the root p, cannot be worse than the payoff of p in any other 
available strategy. Thus, the tuples left in JT after this procedure encode a Pareto Nash 
equilibrium of Q, as it cannot be strictly dominated by any other Nash equilibrium. 

For the sake of completeness, we point out that, differently from the previous case of 
plain Nash equilibria, from JT we cannot compute easily all Pareto Nash equilibria of the 
game in input-output polynomial time. □ 

One may thus wonder whether the above result holds for strong Nash equilibria, too. 
Unfortunately, we next show that computing a Strong Nash equilibrium is a difficult problem 
even in the case of acyclic interactions among players. However, the complexity is reduced 
by one level with respect to the arbitrary interaction case, because checking whether a given 
equilibrium is strong is feasible in polynomial time in the acyclic case. 

Lemma 4.7 Let Q be an acyclic-hypergraph game that has small neighborhood or is in 
graphical normal form, and let x be a global strategy. Then, deciding whether x G SN£{Q) 
is feasible in polynomial time. 

Proof. Since Q has small neighborhood or is in graphical normal form, from Theorem 
4.4 we can build in polynomial time the constraints associated with each player. Moreover, 
its hypergraph H(t/) is acyclic and thus it has a join tree. Let JT be a join tree of H(t/). 
We show how to use JT for deciding in polynomial time whether the strategy x is not in 
SN£{Q), i.e., that there exists a coalition C of players getting an incentive to deviate all 
together from x. Then, the result follows because PTIME is closed under complementation. 
Specifically, we next show an implementation of this task by an alternating Turing machine 
M with a logarithmic-space working tape. Therefore, the problem is in ALOGSPACE, 
which is equal to PTIME (Chandra, Kozen, & Stockmeyer, 1981). 
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The machine M for deciding whether x is not a strong Nash equilibrium works as follows: 

• guess a player q; 

• guess a strategy st q for q that is different from her choice in x; 

• root the tree JT at the vertex corresponding to the characteristic edge H q of player q; 

• check that InCoalition^jT(H g , st q ) returns true, where InCoalition^jT is the Boolean 
function shown in Figure 12. 

Intuitively, the non-deterministic Turing machine first chooses a player q belonging to 
a possible coalition C disproving x. Thus, q should improve her payoff, and in general - 
unless x is not a strong Nash equilibrium, getting this improvement may require that some 
of her neighbors K q deviate from x and hence belong to C. However, in this case, all players 
in K q should be able to improve their payoffs. Again, to do that, they can involve other 
players in the coalition, and so on. 

Whether or not this process is successful is checked by the recursive Boolean function 
InCoalition^jT , which takes in input a vertex H p of the join tree JT and a combined 
strategy st. Recall that each vertex of the join tree is an (hyper)edge of the hypergraph, 
corresponding to a player of Q. In particular, H p is the characteristic edge of player p. 
InCoalition Xj jT has to check whether all players deviating from the given global strategy x 
are able to improve their payoffs. At the first call of this function, the first parameter H q 
is the root of JT and identifies the first player q chosen for the coalition C. The second 
parameter st is the strategy chosen by q, which is different from q's corresponding choice 
in x. At a generic recursive call, the first parameter H p identifies a player p to be checked, 
and the second parameter st encodes a combined strategy for the player w associated with 
the parent H w of H p in JT and for w 7 s neighbors. Now, the function has to check that 
either p does not change her choice with respect to x, or she changes and improves her 
payoff. To this end, the function guesses a tuple st' £ r p , where r p is the constraint relation 
associated with p. Then, st' encodes a combined strategy for p and her neighbors. This 
strategy has to match the parameter st on the players they have in common, because st 
contains the actions already chosen by the algorithm when the parent H w of H p has been 
evaluated. Then, if p's choice in st' is different from p's choice in x, it means that p has been 
non-deterministically chosen as a member of the coalition C. Thus, p should improve her 
payoff, or she immediately causes the fail of this computation branch of the nondeterministic 
Turing machine. Otherwise, that is, if p plays the same action as in x, then she does not 
belong to C and the function has to check, recursively, that in the rest of the join tree all 
deviating players improve their payoffs. This is done by propagating the current combined 
strategy st' to the children of H p in JT. Observe that this propagation is necessary even if 
p does not belong to C, because connected coalitions do not necessarily induce connected 
subtrees in JT. Indeed, it may happen that some player z belonging to the coalition is a 
neighbor of both p and w, but her characteristic edge H z occurs far from H w in the join 
tree, possibly in the subtree of JT rooted at p. (For the sake of completeness, note that in 
this case z should be a neighbor of all players occurring in the path from H z to H w in JT, 
from the connectedness property of join trees.) 
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Figure 13: On the left: the dependency graph of the game G(<& s )- On the right: a coalition 
witnessing that C5 and C7 are playing in a conflicting way. 



Finally, let us consider briefly the low-level implementation of the alternating Turing 
machine M. Existential states correspond to guesses, while universal states correspond to 
the recursive calls to InCoalition^jT > plus some further machinery for auxiliary computa- 
tions. At each step, we have to encode on the worktape the two parameters p and st and the 
local variables, while x, JT, the game Q and the pre-computed constraint relations are on 
the input tape. Note that p may be encoded by the logspace pointer to her position in the 
input tape, as well as any combined strategy st w may be encoded by a logspace pointer to 
its corresponding entry in the constraint relation associated with w. Similar considerations 
apply to the other local variables, e.g., the guessed combined strategy st'. Moreover, it is 
easy to check that all the computations performed by the function are feasible in logspace. 
Therefore M is a logspace ATM, and the overall computation is in PTIME. (For a detailed 
description of such logspace ATM computations, we refer the interested reader to Gottlob 
et al., 2001; Gottlob, Leone, & Scarcello, 2002a). □ 



Theorem 4.8 Let Q be an acyclic-hypergraph game that has small neighborhood or is in 
graphical normal form. Then, deciding whether Q has strong Nash equilibria, i.e., SJ\f£{Q) 7^ 

is NY* -complete. Hardness holds even if Q is in graphical normal form and has 3-bounded 
neighborhood. 

Proof. Membership. Given the game Q, we can guess a global strategy x and verify in 
polynomial time, by Lemma 4.7, that x is in fact a strong Nash equilibrium. 

Hardness. The reduction is from SAT. Consider a Boolean formula in conjunctive normal 
form <I> = ci A . . . A c m over variables X\, . . . , X n and assume, w.l.o.g, that m = 2 , for some 

1 > 0. As a running example, consider the formula & s = (X\ V X2) A (X\ V A3) A {X\ V 
^A 4 V X 8 ) A (A 4 ) A (^A 5 V ^A 6 ) A (X x V A 4 V A 6 ) A (A 6 V X 7 ) A (A 8 ). 

From <£, we build the following GNF game G(&)- The players are partitioned in two 
sets P c and Pt- The set P c contains exactly one player for each clause of while players 
in Pt are such that G(Q) is a complete binary tree, whose leaves are the players in P c , as 
shown in Figure 13 for <I> S . 
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Players in play actions corresponding to variables in $ plus some further special 

actions. Intuitively, each player c G P c may play a literal occurring in the clause she 
represents, while players in P t have to check that no pair of players Ci,Cj G P c plays in 
a conflicting way, that is, plays complementary literals. To this end, the game rules are 
designed in such a way that players in P t may improve their payoffs if they are able to 
form a coalition proving that some pair of players are playing complementary literals. It is 
worthwhile noting that, in general, this situation cannot be detected by any single player, 
since the conflicting clauses may be very far from each other. For instance, in Figure 13, C5 
and C7 play xq and xq, respectively, which is detected by a coalition involving their lowest 
common ancestor, say p, and the players of Pt occurring in the two paths from C5 and C7 to 
p. We show that a global strategy is a strong Nash equilibrium of this game if and only if 
there is no such a disproving coalition. Indeed, in this case, there are no conflicting clauses 
and thus the formula <I> is satisfiable by setting to true all literals played by the clause 
players. 

Formally, each player c G P c may play either a special action B (read: bad) or an action 
Xi (resp. x~i) called literal action, provided that Xi is a variable occurring positively (resp. 
negatively) in the corresponding clause of <£. Each player t G Pt may play an action in 
{vi,Wi,v)i I Xi is a variable in <!>} U {T}, where T can be read as "okay with me!" 

We next describe the utility functions, given any global strategy x. 

A player c G P c gets payoff 1 if she plays a literal action and her unique neighbor (i.e., 
her parent) plays T, or if she plays B and her neighbor does not play T (C-i); otherwise, 
she gets payoff (C-ii). 

For a player t G Pt, the utility function u t is such that: 

(T-i) uj(x) = 2 if t plays Wi, her parent (if any) plays wi or Vi, none of her children plays 
B, and one of her children plays either Wi or xi (depending on whether she is a leaf 
or not); 

(T-ii) Ut(x) = 2 if t plays Wi, her parent (if any) plays Wi or Vi, none of her children plays 
B, and one of her children plays either uii or xf, 

(T-iii) u<(x) = 2 if t plays Vi, her parent (if any) plays T, and her children play either xi 

and xi or Wi and wf, 

(T-iv) u t (x) = 1 if t plays T; 

(T-v) «t(x) = in all the other cases. 

Then, G(&) has the following properties. 

Pi : Let x be a global strategy for G{&)- Then, x is a Nash equilibrium if and only if all 
players in P t play T in x and there is no player in P c playing B. 

If players in P t play T and players in P c do not play B, then they get payoff 1 due 
to rules (T-iv) and (C-i). In this case, no player has an incentive to deviate, since by 
changing strategy she would get payoff due to rules (T-v) and (C-ii). 

For the other direction of the proof, let x be a Nash equilibrium and assume, by 
contradiction, that there is a player c G P c choosing B. From (C-i) and (C-ii), it 
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follows that some neighbor of c, say t, does not play T. However, this is impossible, 
because t would get payoff (from T-v) and could improve her payoff by playing T, 
contradicting the fact that x is a Nash equilibrium. Next, assume there exists a player 
in P t that does not play T, and let t G Pt be a player at the lowest possible level of 
the tree satisfying this assumption. It follows that the children of t are clause players, 
for otherwise, by the choice of t, both of them should play T, and thus t would get 
payoff (T-V) and could improve to 1 by playing T. Therefore, Neigh(t) n P c / 0. 
Then, the only way for t to get payoff greater than comes from rule (T-iii), which 
means that her clause children play in a conflicting way, say x\ and Xj. However, since 
t does not play T, they both get payoff and thus could deviate from x by playing B 
and getting payoff 1. Contradiction. 

P2 : Let x be a Nash equilibrium for Q (<J>) . Then, a coalition of players getting an incentive 
to deviate from x exists if and only if there are two clauses playing in x in a conflicting 
way. 

(If part.) Since x is a Nash equilibrium, from Property Pi, all players in Pt play T and 
get payoff 1. If there are two clauses, say c\ and C2, playing Xi and x~i, respectively, 
we may identify an improving coalition as follows: let t be first common ancestor of 
ci and C2, and let Pi and P2 be the sets of vertices (players) occurring in the paths 
from t to ci and C2, respectively. Then, let t change to Vi, and all the players in Pi 
(resp. P2) change to W{ (resp. Wi) in x - see Figure 13. Then, from the game rules 
above, all players in the coalition K = Pi U P2 U {t} get payoff 2, improving the payoff 
1 that they get in x. 

(Only-if part.) Let K be a coalition of players improving the Nash equilibrium x. 
From property Pi, all players in P t n K should get payoff 2, as they get 1 in x. Let 
t G K by the player in P t at the highest (close to the root) level in the tree, i.e., such 
that parent(t), if any, does not belong to K. From (T-iii), the children of t must play 
either X{ and x~i or wi and Wi, depending on whether they are or are not leaves of 
the tree. In the former case, we have identified two conflicting players and thus the 
property is immediately proved. Hence, let us investigate the latter one. Let t' and t" 
be the children of t playing wi and Wi, respectively. Since they do not play T, both t' 
and t" belong to K and have to improve their payoff to 2. Therefore, a child of t' must 
play Wi and a child of t" must play Wi, according to (T-i) and (T-ii). Therefore, these 
players belong to K, too, and the same happen for some of their children. Eventually, 
a leaf descendant of t! plays xi and a leaf descendant of t" plays x~i, qed. 

The NP hardness of deciding the existence of a SNE follows from the following claim: <I> 
is satisfiable -£4> G{<&) admits a strong Nash equilibrium. 

(=>) Assume $ is satisfiable and take a satisfying assignment a. Let x CT be a global 
strategy such that: each player c G P c plays any literal occurring in the clause c that is true 
with respect to a; and each player t G Pt plays T. From Pi, x CT is a Nash equilibrium for 
G(&). Moreover, by construction no pair of players choose conflicting actions in x CT . Hence, 
due to P2, there exists no coalition of players getting an incentive by deviating from x CT , 
and thus x CT is strong. (<^=) Let x be a strong Nash equilibrium for G(&). Then, there is 
no coalition of players getting an incentive to deviate from x. Due to Pi, no player in P c 
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plays B, and due to P2 no pair of players play in a conflicting way. Hence, cr x witnesses 
that <I> is satisfiable. More precisely, it encodes an implicant of <&, that can be extended to 
a satisfying assignment choosing any truth value for all Boolean variables occurring in 
not chosen by any player in x. □ 



5. Further Structurally Tractable Classes of Games 

For strategic games, both the acyclic graph and the acyclic hypergraph assumptions are 
very severe restrictions, which are rather unlikely to apply in practical contexts. In this 
section, we prove that even more general and structurally complicated classes of games 
can be dealt with in an efficient way. We consider the notions of treewidth (Robertson & 
Seymour, 1986) and hypertree width (Gottlob et al., 2002b), which are the broadest known 
generalizations of graph and hypergraph acyclicity, respectively (Gottlob et al., 2000). We 
show that tractability results for acyclic games hold for these generalizations, too, and study 
the relationship between the two notions. 

5.1 Hypertree Decompositions of Games 

Let H = (V, E) be a hypergraph. Denote by vert(H) and edges(H) the sets V and E, 
respectively. Moreover, for any set of edges E' C edges(H), let vert(E') = \J heE , h. 

A hypertree for a hypergraph H is a triple (T, x, A), where T = (N,E) is a rooted 
tree, and x an d A are labeling functions which associate with each vertex p G N two 
sets x(p) — vert(H) and A(p) C edges(H). If T' = (N',E r ) is a subtree of T, we define 
x(T') = \J veNI x( v )- We denote the root of T by root(T). Moreover, for any p G N, T p 
denotes the subtree of T rooted at p. 

Definition 5.1 (Gottlob et al., 2002b) A hypertree decomposition of a hypergraph H 
is a hypertree HD = (T, x, A) for H, where T = (N,E), which satisfies all the following 
conditions: 

1. for each edge h G edges(R), there exists p G N such that vert(h) C x{p) (we say that 
p covers h); 

2. for each vertex Y G vert(H), the set {p G N \ Y G x(p)} induces a (connected) subtree 
of T; 

3. for each p£jV, x(p) ^ vert(X(p)); 

4. for each p G N, vert{\{p)) n x( T p) ^ x(p)- 

An edge h G edges(R) is strongly covered in HD if there exists p G N such that vert(h) C 
x(p) and h G A(p). In this case, we say that p strongly covers h. A hypertree decomposition 
HD of hypergraph H is a complete decomposition of H if every edge of H is strongly covered 
in HD. The width of a hypertree decomposition (T, x, A) is raa£ p et,ertices(T)|A(p)|. The 
hypertree width hw(H) of H is the minimum width over all its hypertree decompositions. 

Note that for any constant k checking whether a hypergraph has hypertree-width at 
most k is feasible in polynomial time (Gottlob et al., 2002b). 
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Figure 14: H(FRIENDS') and a hypertree decomposition for it. 

Let k > be a fixed constant. Then, we say that a game Q has /c-bounded hypertree 
width if the hypertree width of its associated hypergraph H((?) is at most k. A hypertree 
decomposition of width at most k (if any) can be computed in polynomial time. 

Recall that the notion of bounded hypertree-width generalizes the notion of (hyper- 
graph) acyclicity. In particular, the class of acyclic-hypergraph games is precisely the class 
of games Q whose hypergraph H(CJ) has hypertree width 1. 

Example 5.2 Consider again the game FRIENDS in Example 2.1. Figure 5 shows on the 
left its associated hypergraph, and on the right a join tree for it. In fact, this join tree is a 
hypertree decomposition of width 1 for the hypergraph, where, for each vertex p, A(p) is the 
set of hyperedges reported in p and x(p) 1S the set of players occurring in these hyperedges. 

For a more involved example, consider the extension FRIENDS' of FRIENDS where a 
new player Laura (short: L) joins the group. Laura would like to go with George to the 
cinema, and with Pauline and Mary to the opera. Figure 14 shows on the left the hyper- 
graph H(FRIENDS'). This hypergraph is not acyclic, but with a low degree of cyclicity. 
Indeed, its hypertree width is 2, as witnessed by the hypertree decomposition of width 2 
shown on the right, in Figure 14. Here, for each vertex p of the decomposition tree, the two 
sets denote its labels x{p) an d A(p), respectively. □ 

A class of games C is said to have bounded hypertree-width if there is a finite k such 
that, for each game Q € C, Q has fc-bounded hypertree width. We next show that all the 
tractability results that hold for acyclic-hypergraph games holds for bounded hypertree- 
width games, as well. 

Theorem 5.3 Deciding the existence of pure Nash equilibria, as well as computing a Nash 
equilibrium is feasible in polynomial time for all classes C of games having bounded hypertree- 
width and such that every game Q £ C has small neighborhood or is in graphical normal 
form. 

Proof. Let C be a class of games such that each game Q € C has hypertree-width at most 
k, for some k > 0, and has small neighborhood or is in graphical normal form. Then, we 
can build the constraint satisfaction problem CSP{Q) in polynomial time, by Theorem 4.4. 
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Moreover, the hypertree width of Q is at most k, and its hypergraph H(C?) is the same as 
the hypergraph H associated with CSP(G). From results by Gottlob et al. (2001), it follows 
that CSP{Q) can be solved in polynomial time, which is equivalent to deciding the existence 
of Nash equilibria in polynomial time, by Theorem 4.3. 

Constructively, we can compute in polynomial time a hypertree decomposition of H hav- 
ing width at most k, exploit this decomposition for building an equivalent acyclic problem 
(by putting together the constraints of players occurring in the same vertex of the decom- 
position tree), and finally solve this problem by using the algorithm shown in Figure 10. □ 

As for acyclic-hypergraph games, this result can be immediately extended to the problem 
of computing a Pareto Nash equilibrium. 

Corollary 5.4 Deciding the existence of Pareto Nash equilibria, as well as computing a 
Pareto Nash equilibrium for pure strategies is feasible in polynomial time for all classes 
C of games having bounded hypertree-width and such that every game Q G C has small 
neighborhood or is in graphical normal form. 

5.2 Treewidth and Hypertree Width of Games 

We next consider the treewidth of game structures. Recall that any game may be repre- 
sented either by the primal graph or by the dual graph, as shown in Figure 5 for the game 
FRIENDS. Therefore, a first question is which graph is better as far as the identification of 
tractable classes of games is concerned. From the results by Gottlob et al. (2000), we know 
that the notion of bounded treewidth for the primal graph is generalized by the notion of 
bounded hypertree width, that is, looking at the hypertree width of the game hypergraph 
we may identify wider classes of tractable games. Moreover, from the results by Greco and 
Scarcello (2003), it follows that looking at the treewidth of the dependency graph is better 
than looking at the treewidth of the primal graph. 4 

We thus know that bounded treewidth for the primal graph is sufficient for ensuring 
game tractability. However, two questions are still to be answered, and will be the subject 
of this section: 

1. Do tractability results for bounded treewidth for the primal graph extend to the wider 
class of games having bounded treewidth for the dependency graph? 

2. What is the relationship between bounded treewidth for the dependency graph and 
bounded hypertree width of the game hypergraph? 

Definition 5.5 (Robertson & Seymour, 1986) A tree decomposition of a graph G = 
(V,E) is a pair (T, where T = (N,F) is a tree, and \ is a labeling function assigning 
to each vertex p G N a set of vertices \{p) ^ V, such that the following conditions are 
satisfied: 

(1) for each vertex b of G, there exists p G N such that b G x(p)', 

4. In fact, this result is on relationship between primal graph and incidence graph. However, it is easy to 
see that, for games, the treewidth of the incidence graph is the same as the treewidth of the dependency 
graph. 
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Figure 15: G(FRIENDS') and a tree decomposition for it. 

(2) for each edge {b, d} € E, there exists p G N such that {b, d} C x{p)\ 

(3) for each vertex b of G, the set {p € N \ b £ xip)} induces a connected subtree of T. 

Note that Condition 1 is subsumed by Condition 2 for graphs without isolated vertices. 
The width of the tree decomposition (T,x) is maxpg^r \x(p) — 1|- The treewidth of G is the 
minimum width over all its tree decompositions. This notion generalizes graph acyclicity, 
as the acyclic graphs are precisely those graphs having treewidth 1. 5 

Example 5.6 Consider again the game FRIENDS' introduced in the Example 5.2. Fig- 
ure 15 shows on the left the cyclic dependency graph G (FRIENDS'), and on the right a 
tree decomposition of width 3 of this graph. □ 



Let k > be a fixed integer, and let Q be a game. We say that a game Q has /c-bounded 
treewidth if the treewidth of its dependency graph G{Q) is at most k. Recall that, given 
a graph G, computing a tree-decomposition of width at most k of G (if any) is feasible in 
polynomial (actually, linear) time (Bodlaender, 1997). 

We next prove an interesting graph-theoretic result to shed some light on the different 
possible representations of game structures: every class of games having bounded treewidth 
has bounded hypertree width, too. We remark that the previous results on the relationship 
between treewidth and hypertree width described in the literature (e.g. Gottlob et al., 
2000) cannot be used here. Indeed, they deal with the primal graph and the dual graph 
representations, while we are now interested in the dependency graph, which is more effective 
than the primal graph, and somehow incomparable with the (optimal) dual graph. A 
detailed comparison of these two latter notions is reported by Greco and Scarcello (2003). 

Theorem 5.7 For each game Q , hypertreewidth(K(Q)) < treewidth (G(G)) + 1. 

Proof. Let TD be a tree decomposition of G{Q) and let k — 1 be its width, that is, 
the largest label of the vertices of TD contains k players. Then, we show that there is a 
hypertree decomposition of H(C/) having width k. Recall that H(C?) contains, for each player 

5. Observe that the "—1" in the definition of treewidth has been introduced in order to get this correspon- 
dence with acyclic graphs, as 2 is the minimum cardinality for the largest label in any tree decomposition. 



394 



Pure Nash Equilibria: Hard and Easy Games 



p, the characteristic edge H(p) = {p} U Neigh(p). Let HD = (T, x, A) be a hypertree such 
that: 

• the tree T has the same form as the decomposition tree TD, i.e., there is a tree 
isomorphism 5 : vert(T) — > vert(TD) between T and TD; 

• for each vertex v G T, X(v) = {H(p) | p G i- e -> M v ) contains the characteristic 
edge of each player occurring in the vertex of the tree decomposition corresponding 
to v; 

• x( v ) is the set of all vertices occurring in the edges in X(v), i.e., contains all players 
in 5(v) and their neighbors. 

Note that the width of HD is k, as it is determined by the largest A label, which contains 
the same number of elements as the largest label in TD. 

We claim that HD is a hypertree decomposition of H(£). Consider the four conditions 
in Definition 5.1: Conditions 3 and 4 are trivially satisfied because, for each vertex v, 
x(v) = vert{\{v)), by construction. Condition 1 is guaranteed by the fact that TD satisfies 
its corresponding Conditions 1 and 2. We next show that Condition 2, i.e., the connectedness 
condition, holds, too. 

Let v\ and V2 be two vertices of T such that there exists p G x( v i)^x( v 2)- Let v[ = 5(vi) 
and v' 2 = S(v2) be the sets of vertices in the tree decomposition TD corresponding to v\ and 
V2, respectively. Since p G xi v i) an d p G x( v 2), there are two players p\ and p2 such that (i) 
H(pi) G X(v\) and p G H{pi), and (ii) H(p2) € A(t>2) and p G H{p2)- Then, by construction, 
Pi G v[ and p2 G v' 2 (see Figure 16). 

We claim that, for each vertex v in the unique path connecting v\ and V2 in T (denoted 
by v\ V2), X(v) contains a player from the set {pi,P2,p}, which entails that p G x( v ) 
and hence that Condition 2 is satisfied by HD. This is equivalent to claim, on the tree 
decomposition TD, that each vertex v' in the path v[ v' 2 contains a player in {pi,P2,p}- 

If both v[ and v' 2 contain p, then the claim trivially holds because all the vertices in the 
path v 1 <r~> v' 2 must contain p, from Condition 3 of tree decompositions (the connectedness 
condition). 

Hence, let us assume that v[ does not contain p. Since p G H(p\), this means that p is 
a neighbor of p\ and thus there exists a vertex of TD, say v' 3 v[, whose labeling contains 
both p and p\. Assume now that v 2 contains p. Figure 16.1 shows the path comprising 
vertices v[ , v' 3 , and v 2 — notice that v[ cannot be in the path v' 3 v 2 , otherwise it should 
contain p as well. The result follows by observing that, again from Condition 3 of tree 
decompositions, all vertices in the path v[ v' 3 must contain p\, and all vertices in the 
path i>3 v 2 must contain p. Similarly, assume that v 2 does not contain p. In this case, 
since p is a neighbor of P2 (recall the above discussion for p\), there is a vertex v' 4 in TD 
whose labeling contains both P2 and p. Figure 16.2 shows how these vertices should look 
like in the tree decomposition TD. Then, the result follows by observing that all vertices in 
the path v[ <^> v' 3 contains pi, all vertices in the path v' A contains p, and all vertices 

in the path v' 4 v' 2 contains p2- □ 

We next show that the converse does not hold, that is, there are classes of games having 
bounded hypertree width, but unbounded treewidth. That is, the technique based on the 
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Figure 16: Schema of the reduction in the proof of Theorem 5.7. 



hypertree width of the game hypergraph is more effective than the corresponding technique 
based on the treewidth of the dependency graph, because it allows us to identify strictly 
broader classes of tractable games. 

Theorem 5.8 There are classes C of games having hypertree width 1 but unbounded 
treewidth, i.e., such that, for any finite k > 0, there is a game Q € C such that the treewidth 
of G is not bounded by k. 

Proof. Take the class of all games where every player depends on all other players. For 
every such game Q, H(C?) is acyclic and thus its hypertree width is 1, while G(Q) is a clique 
containing all players and its treewidth is the number of players minus 1. □ 
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From Theorem 5.3, Corollary 5.4, and Theorem 5.7, we immediately get the following 
tractability results for bounded treewidth games. 

Corollary 5.9 Deciding the existence of pure (Pareto) Nash equilibria, as well as com- 
puting a pure (Pareto) Nash equilibrium is feasible in polynomial time for all classes C of 
games having bounded treewidth and such that every game Q G C has small neighborhood or 
is in graphical normal form. Moreover, all Nash equilibria of such games can be computed 
in time polynomial in the combined size of input and output. 

6. Parallel Complexity of Easy Games 

In this section, we show that dealing with Nash equilibria for games with good structural 
properties is not only tractable but also parallelizable. More precisely, we show that deciding 
the existence of Nash equilibria for graphical games where the player interactions has a low 
degree of cyclicity is complete for the class LOGCFL. Also, we show that computing such 
an equilibrium belongs to the functional version of LOGCFL. 

The complexity class LOGCFL consists of all decision problems that are logspace re- 
ducible to a context-free language. In order to prove the following theorem, we exploit a 
characterization of LOGCFL in terms of circuits. 

We recall that a Boolean circuit G n with n inputs is a finite directed acyclic graph whose 
nodes are called gates and are labeled as follows. Gates of fan-in (indegree) zero are called 
circuit input gates and are labeled from the set {false, true, z\, z-i, . . . , z n , ->zi, ~'Z2, ■ ■ ■ , ^z n }. 
All other gates are labeled either AND, OR, or NOT. The fan-in of gates labeled NOT must 
be one. The unique node with fan-out (outdegree) zero is called output gate. The evaluation 
of G n on input string w of length n is defined in the standard way. In particular, any input 
gate g labeled by Zj (resp. -*Zi) gets value true (resp. false) if the ith bit of w is 1 (resp. 0); 
otherwise, g gets value false (resp. true). 

A Boolean circuit is thus given as a triple (N, A, label), where N is the set of nodes 
(gates), A is the set of arcs, and label is the labeling of the nodes as described. 

The depth of a Boolean circuit G is the length of a longest path in G from a circuit 
input gate to the output gate of G. The size S(G) of G is the number of gates (including 
input-gates) in G. 

A family Q of Boolean circuits is a sequence (Go, G\, Gi, . . .), where the nth circuit G n 
has n inputs. Such a family is logspace-uniform if there exists a logspace Turing machine 
which, on the input string containing n bits 1, outputs the circuit G n . Note that the size 
of the nth circuit G n of a logspace-uniform family Q is polynomial in n. Intuitively, this 
uniformity condition is crucial in characterizations of low parallel complexity classes in terms 
of circuits, because hidden inherent sequentialities in the circuit construction process must 
be avoided. In fact, the cicuits which serve as parallel devices for evaluating input strings of 
length n, and which must be constructed for each n separately, should be constructible in 
parallel themselves. This is assured by requiring logspace uniformity, because LOGSPACE 
is a highly parallelizable complexity class contained in LOGCFL. 

The language L accepted by a family Q of circuits is defined as follows: L = U n >o^ n ' 
where L n is the set of input strings accepted by the nth member G n of the family. An input 
string w of length n is accepted by the circuit G n if G n evaluates to true on input w. 
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A family Q of Boolean circuits has bounded fan-in if there exists a constant c such that 
each gate of each member G n of Q has its fan-in bounded by c. 

A family Q of Boolean circuits is semi-unbounded if the following two conditions are met: 

• All circuits of Q involve as non-leaves only AND and OR gates, but no NOT gates 
(negation may thus only occur at the circuit input gates); and 

• there is a constant c such that each AND gate of any member G n of Q has its fan-in 
bounded by c (the OR gates may have unbounded fan- in). 

For i > 1, ACj denotes the class of all languages recognized by logspace- uniform families 
of Boolean circuits of depth 0(log*n). 

For i > 1, NCj denotes the class of all languages recognized by logspace- uniform families 
of Boolean circuits of depth 0(log* n) having bounded fan-in. 

For i > 1, SAC* denotes the class of all languages recognized by semi-unbounded 
logspace- uniform families of Boolean circuits of depth 0(log* n). 

Venkateswaran (1991) proved the following important relationship between LOGCFL 
and the semi-unbounded circuits: 

LOGCFL = SAC 1 . 

Since LOGCFL = SAC 1 C ACi C NC 2 , the problems in LOGCFL are all highly 
parallelizable. In fact, each problem in LOGCFL is solvable in logarithmic time by a 
concurrent-read concurrent-write parallel random access machine (CRCW PRAM) with 
a polynomial number of processors, or in log 2 -time by an exclusive-read exclusive-write 
PRAM (EREW PRAM) with a polynomial number of processors (Johnson, 1990). 

We next show that the evaluation problem of SAC 1 circuits can be transformed in 
logspace into the considered Nash equilibrium existence problems. 




A) B) C) 



Figure 17: (A) A normalized circuit, (B)its skeleton tree, (C) a labeling corresponding to a 
proof tree. 



Theorem 6.1 The existence problem for pure Nash equilibria is LOGCFL- complete for the 
following classes of strategic games in graphical normal form: acyclic-graph games, acyclic- 
hypergraph games, games of bounded treewidth, and games of bounded hypertree- width. 
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Proof. It is sufficient to show membership for bounded hypertree width (the largest of the 
4 classes) and hardness for acyclic-graph games (the smallest one). 

Membership. The Nash equilibrium existence problem for NF games of bounded hyper- 
tree width is in LOGCFL because, as shown in Section 4, this problem can be transformed 
in logspace into a CSP of bounded hypertree width, and, as shown by Gottlob et al. (2001), 
checking satisfiability of the latter is in LOGCFL. (Recall that LOGCFL is closed under 
logspace reductions.) 

Hardness. We assume that a logspace-uniform family C = {G\,G2, . . .} of SAC 1 circuits 
is given, and we prove that the problem of checking whether a binary string w is accepted 
by C can be translated in logspace to an acyclic Nash equilibrium problem in NF. 

On input w, compute in logspace the appropriate circuit C = G\ w \. As shown by Gottlob 
et al. (2001), this circuit can be transformed in logspace into an equivalent normalized circuit 
C which is stratified and strictly alternating (see Figure 17 (A)), and a tree-shaped proof 
skeleton SKEL (see Figure 17 (B)) which encompasses the common structure of all possible 
proof trees for (C',w). A proof tree is a subtree of C of gates having value 1 witnessing 
that C accepts w. Each proof tree corresponds to an appropriate labeling of SKEL with 
gates from C (for example, the labeling shown in Figure 17 (C)). A labeling is correct if 
the root of SKEL is labeled with the output gate of C , each AND gate labeled g has two 
children that are labeled with the input gates to g, each OR node of SKEL labeled g has 
one child labeled with some input gate to g, and each leaf of T is labeled with an input gate 
to C whose output to the next higher level is 1. C accepts w if and only if there exists a 
proof tree for (C',w), and thus if there exists a correct labeling of SKEL. 

Build a strategic game Q from (C, w) and SKEL as follows. The set of players consists 
of all vertices V of SKEL plus two special players a and [3. The possible actions for the 
players in V are pairs (g,t), where g is a gate and t is a truth value in {true, false}. The 
utilities for players in V are given as follows. 

1. The utility of each leaf u of SKEL only depends on its action and is 1 if it plays an 
input gate g of C and if g is associated with the constant true, or g is a —> gate and 
corresponds to an input bit of the string w, or g is not a -> gate and corresponds to 
an input bit 1 of w. Otherwise, the utility of u is 0. 

2. Each non leaf vertex p G V gets payoff 1, if it plays an action (g, true), and if either 
p is an OR vertex and the unique child of p in SKEL takes action (g', true), and g' 
is a child of the gate g in C' , or p is an AND vertex and the unique children of p 
in SKEL take actions (</, true), and (g" , true), respectively, where g' and g" are the 
children of the gate g in C'. 

3. Each non leaf vertex p G V gets payoff 1, if it plays an action an action (g, false), and 
if either p is an OR vertex and the unique child of p in SKEL takes action (g 1 , false), 
and g' is a child of g in C' , or p is an AND vertex and the unique children of p in 
SKEL take actions (g',t'), and (g",t"), respectively, where g' and g" are the children 
of g in C' and t' A t" = false. 

4. In all other cases, all actions of a non leaf vertex p £ V have utility —1. 

According to what we have defined so far, it is easy to see that every Nash equilibrium 
of the game corresponds to a labeling of SKEL by assigning each player of V the gate g 
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of its respective action (g,t). In particular, the root node r is forced to be labeled with the 
output gate g* of C, and the action played by r is (g* , true) if and only if the particular 
labeling is a proof tree and (g* , false) otherwise. 

It remains to define the actions and utilities for the special players a and (3. Their 
intuitive role is to "kill" all those equilibria which do not correspond to a proof three i.e., 
those where the root vertex plays {g* , false)). The possible actions are {ok, head, tail} for 
a, and {head, tail} for (3. The strategies where a plays ok have utility 1 for a if the root 
vertex r of SKEL plays (g*, true)) and utility otherwise. Strategies where a plays head 
(resp., tail) have utility 1 for a if r plays (g* , false) and if (3 plays tail (resp., head), and 
otherwise. Thus, in case r plays (g* , false), player a tries to play the opposite of player 
(3. The strategies where (3 plays head (resp., tail) have utility 1 for player (3 if a plays the 
same action, and otherwise. 

Therefore, in case C outputs on input w, r plays (g* , false), and thus a tries to play 
opposite to (3 while (3 tries to mimic a. This is a classical non-equilibrium situation. In 
summary, each Nash equilibrium of Q corresponds to a proof tree for {C',w). Note also 
that G(Q) is acyclic, and that the construction of Q from (C , w) can be done in logspace. □ 

Note that, by Definition 2.2, a Pareto Nash equilibrium exists if and only if a Nash 
equilibrium exists. 

Corollary 6.2 The existence problem for pure Pareto Nash equilibria is LOGCFL- complete 
for the following classes of strategic games in graphical normal form: acyclic-graph games, 
acyclic-hypergraph games, games of bounded treewidth, and games of bounded hypertree- 
width. 

Finally, as far as computation of Nash equilibria is concerned, the following corollary 
follows from the above result and from a result by Gottlob at al. (2002a), stating that 
witnesses (i.e., proof trees) of LOGCFL decision problems can be computed in functional 
LOGCFL (i.e., in logspace with an oracle in LOGCFL, or, equivalently, by using SAC 1 
circuits. 

Corollary 6.3 For the classes of games mentioned in Theorem 6.1, the computation of 
a single pure Nash equilibria can be done in functional LOGCFL, and is therefore in the 
parallel complexity class NC2- 

7. Conclusion 

In this paper we have determined the precise complexity of pure Nash equilibria in strategic 
games. As depicted in Figure 2, our study proceeded along three directions: representa- 
tion issues, structural properties of player interactions, and different notions of equilibria. 
Indeed, besides "plain" Nash equilibria, we considered Pareto and Strong Nash equilibria, 
where we look for Nash equilibria that are not dominated by any other Nash equilibrium, or 
for profiles where no possible coalition of players may improve the payoffs of all its members, 
respectively. 

It turns out that, apart from the simple case of standard normal form, deciding the 
existence of Nash equilibria is an intractable problem (unless PTIME = NP), if there is no 
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restriction on the relationships among players. Interestingly, for Strong Nash Equilibria, 
this problem is located at the second level of the polynomial hierarchy, and gives us a fresh 
game-theoretic view of the class S^, as the class of problems whose positive instances are 
characterized by a coalition of players who cooperate to provide an equilibrium, and win 
against any other disjoint coalition, which fails in trying to improve the utility for all of its 
players. 

However, this paper is not just a collection of bad news. Rather, a central goal was 
to single out large classes of strategic games where detecting Nash equilibria is a tractable 
problem. In particular, while early studies in game theory mainly focused on games with 
a small number of players (e.g., the traditional two-player framework), we are interested 
here in large population games, too. In such cases, adopting the standard normal form is 
clearly impractical as, for each player, one should specify her payoffs for any combination 
of choices of all players in the game. We thus considered a different representation for these 
games, known in literature as graphical games (Kearns et al., 2001b), where the payoffs 
of each player p are functions of p's neighbors only, that is, p's utility function depends 
only on those players p is directly interested in. These relationships among players may 
be represented as a graph or, more faithfully, as a hypergraph. We showed that, if utility 
functions are represented as tables (graphical normal form) and the game structure is acyclic 
or has a low degree of cyclicity (i.e., it has bounded hypertree width), then deciding the 
existence of a Nash equilibrium and possibly computing it is feasible in polynomial time. 
These results complement those obtained for graphical games in the mixed Nash equilibria 
framework (e.g. Kearns et al., 2001b; Kearns & Mansour, 2002). Moreover, in the case of 
quasi-acyclic structures, we were also able to extend tractability to classes of games where 
utility functions are given implicitly (as in the general form), provided that each player has 
a small number of neighbors with not too many available actions. 

This paper sheds light on the sources of complexity of finding pure Nash equilibria 
in strategic games, and, in particular, on the roles played by game representations and 
game structures. It is worthwhile noting that these aspects of game theory have received 
a renewed deal of attention recently. For instance, see Papadimitriou (2004) for a recent 
work on the complexity of pure Nash equilibria in some particular classes of games, and 
the various contributions on different kinds of concise game representations (e.g. Koller & 
Milch, 2001; Vickrey, 2002; Kearns et al., 2001b; Leyton-Brown & Tennenholtz, 2003; Gal 
& Pfeffer, 2004; Kearns & Mansour, 2002). 

We recall that a preliminary version of the present work has been presented at the 
9th ACM Conference on Theoretical Aspects of Rationality and Knowledge (TARK'03). 
Since then, our results have been extended along different directions. In particular, Alvarez 
et al. (2005) considered a further version of general form games, called games in implicit 
form, where also payoff values are given in a succinct way. They showed that, for such 
games, the complexity of deciding the existence of pure Nash equilibria increases from the 
first level to the second level of the polynomial hierarchy. We point out that our general 
form is slightly different from the general form adopted in the above mentioned paper, and 
some confusion may arise by reading their citation of the results presented in our TARK'03 
paper (whose full version is the present paper). In their terminology, our Turing-machine 
encoding of payoff functions in general form games should be classified as non-uniform, 
with a uniform time-bound. However, apart from such subtle technical issues, some of their 
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results on general form games with non implicit actions are very similar to ours, but their 
contributions focus on games with a large number of actions, while our hardness results hold 
even for games with a fixed number of actions and payoff levels. Moreover, while we show 
that hardness holds even for acyclic games, they did not consider any restriction on player 
interactions. Observe that their results may be immediately strengthened, given that from 
our proofs about GNF games with arbitrary player interactions it follows that NP-hardness 
holds even for constant-time utility functions (as discussed in Remark 3.9). 

Another line of research studies games where the computation of any Nash equilibrium 
is not satisfactory, and one is rather interested in equilibria that satisfy some additional re- 
quirements (e.g., the best social welfare). Greco and Scarcello (2004) proved that deciding 
the existence of such pure Nash equilibria, called constrained Nash equilibria, is intractable 
even for very simple requirements. However, they were also able to identify some restrictions 
(for player interactions and requirements) making both the existence and the computation 
problems easy. Recent contributions on this subject (on both pure and mixed Nash equi- 
libria) have been done by Schoenebeck at al. (2005) and Greco and Scarcello (2005). 

Finally, we observe that there is an interesting connection among strong Nash equilibria 
and some equilibria studied in cooper ative/coalitional game theory (e.g. Mas-Colell, Whin- 
ston, & Green, 1995). In this framework, for each subset K of the players, we are given 
the utility that players in K may get, if they cooperate together. The core of a game is 
the set of profiles x such that there is no subset of players that may improve their util- 
ities by forming their own coalition, deviating from x (Gillies, 1953). Recently, Conitzer 
and Sandholm (2003a) proposed a concise representation for coalition utilities, and showed 
that determining whether the core of such a game is nonempty is NP-hard. An interesting 
future work may concern a detailed study of the complexity of these coalitional games, pos- 
sibly exploiting suitable notions of quasi-acyclic structures for identifying relevant tractable 
classes. 
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